2.1. Study Context, Hydropower Plants, and Forecasting Tasks
Kazakhstan is the world’s largest landlocked country and one of the major power systems in Central Asia, where electricity supply remains strongly dependent on thermal generation, while hydropower contributes to dispatchable flexibility and short-term balancing capability. In this context, hydropower is both an energy source and an operational resource whose short-term behavior is shaped by hydro-meteorological forcing, cascade routing, reservoir operation, water-use constraints, and dispatch decisions. The practical problem addressed in this study is therefore twofold: to improve short-horizon forecasting of hydropower generation and to derive actionable risk-oriented indicators from these forecasts for system operators.
The analysis covers eight hydropower plants (HPPs) in Kazakhstan: Shulbinsk (Shulb), Bukhtarma (Bukh), Ust-Kamenogorsk (Ustk), Leninogorsk (Lenin), Kapchagay (Kapch), Moinak (Moin), Kaskad Almaty (Kask), and Shardara (Shar). These stations represent different hydroclimatic and operational regimes, including large reservoir-based plants, cascade systems, mountain-fed systems, and stations with stronger seasonal variability. As shown in
Figure 1, the analyzed HPPs are distributed across hydroclimatically distinct regions of Kazakhstan, which supports station-specific model development. The spatial map in
Figure 1 was prepared using QGIS version 3.40.13-Bratislava.
According to official Kazhydromet spring-flood assessments, East Kazakhstan and Abay are classified as higher-risk regions, while Almaty and Turkestan are generally assigned to a medium-risk class at the regional scale [
32,
33]. The medium regional class, however, does not imply the absence of hazardous hydrological processes. Kazhydromet hydrological forecasts report rain- and snowmelt-driven river-level rises, slope runoff formation, and precipitation-sensitive dynamics in both eastern and southern/southeastern mountain rivers [
34,
35]. Kazakhstan-based studies further support the hydroclimatic sensitivity of these regions by integrating hydrometeorological monitoring, runoff/indicator mapping, and flood-hazard-oriented analyses at basin and sub-basin scales [
36,
37,
38].
To provide technical and operational context,
Table 1 summarizes the main characteristics of the selected HPPs, including installed capacity, available capacity, number of generating units, and commissioning year. These characteristics are relevant because station-specific operating conditions, unit availability, maintenance sensitivity, and regulation capacity can influence the temporal structure of generation and, consequently, forecasting performance.
The target variable is plant-level active power generation, expressed in MW. The raw generation archive covers 2020–2024 at sub-daily operational resolution and was harmonized to an hourly time grid before daily aggregation. Hydro-meteorological predictors include near-surface air temperature, precipitation, and snow water equivalent (SWE), which are physically relevant for inflow formation and generation dynamics in snow-influenced basins. River water-level observations were treated as optional exogenous predictors because their hydrological representativeness and validation contribution differed across stations.
Two forecasting tasks were addressed. The first task is deterministic multi-step forecasting for short operational lead times D+1–D+7, defined as the prediction of daily generation
for forecast horizons
from forecast origin
(Equation (1)):
where
denotes the observed daily generation at station
on target day
,
denotes the corresponding forecast,
indicates the station,
is the forecast-origin date, and
is the lead time in days.
The second task is medium-range envelope forecasting for the D+8–D+14 window. Instead of predicting each day in the window separately, this task predicts two window-level descriptors: the minimum generation value and the 90th percentile. For a forecast origin date
, the medium-range forecasting window is defined as the set of target days from
to
(Equation (2)):
The corresponding envelope targets are then defined as the minimum generation within this window,
, and the empirical 90th percentile,
, as given in (Equations (3) and (4)):
where
is the lower-bound target for station
and forecast origin
,
is the upper-envelope target based on the empirical 90th percentile, and
denotes daily generation at station
on day
. This envelope formulation is intended for medium-range operational planning, where lower-bound and upper-envelope information may be more useful than unstable day-wise point forecasts alone.
To clarify its relationship to probabilistic forecasting, the MIN-Q90 formulation was additionally evaluated using functional-envelope diagnostics. Because MIN and Q90 are future-window descriptors rather than daily calibrated probabilistic intervals, they were assessed as window-level functionals. The diagnostic evaluation therefore included the absolute error of the predicted MIN, the absolute error of the predicted Q90, the error in the predicted envelope width, and the Q90 pinball loss as a quantile-oriented metric for the upper-envelope target. This links the proposed envelope formulation to interval and quantile forecasting concepts while preserving its operational interpretation as a medium-range planning tool rather than a fully calibrated probabilistic forecasting framework.
2.2. Data Harmonization, Quality Control, and Daily Aggregation
Reliable short-term hydropower forecasting requires input series that are both physically consistent and statistically stable. Raw operational archives collected under heterogeneous logging and reporting practices may contain timestamp inconsistencies, non-physical spikes, negative values, missing values, and telemetry-related artifacts. If untreated, these artifacts can propagate into lagged feature construction, bias model calibration, and distort out-of-sample evaluation. Therefore, a dedicated harmonization and quality-control (QC) pipeline was applied before model training.
The raw table was first standardized by normalizing column names, correcting Cyrillic/Latin character substitutions, harmonizing precipitation labels, and converting numerical fields to floating-point format. The date and time fields were combined into a single datetime index. Records with invalid timestamps were removed, and all remaining observations were sorted chronologically. The dataset was then resampled to an hourly time grid using hourly averaging (Equation (5)):
where
is a raw observation for station
at timestamp
,
is the corresponding hourly value,
is the hourly timestamp, and
is the set of raw observations falling within hour
. Hourly averaging was used for generation and meteorological descriptors.
Installed capacity was used as a station-specific physical screening bound. Let
denote hourly generation at station
and hour
, and let
denote the installed capacity of station
. To allow for minor reporting and rounding deviations, a tolerance factor of 1.05 was applied. Values above 105% of installed capacity and negative generation values were treated as physically implausible and set to missing before imputation (Equation (6)):
where
is the quality-controlled hourly generation value, and
denotes a missing value introduced either by the original archive or by the QC procedure. Equation (6) prevents physically implausible upward spikes and negative generation artifacts from dominating model fitting and error statistics.
For each station, the QC pipeline recorded the maximum generation before QC, the maximum generation after QC, the number and share of observations exceeding 105% of installed capacity, and the maximum percentage exceedance. Consecutive exceedance runs were also analyzed to distinguish isolated telemetry spikes from longer systematic reporting artifacts. A long exceedance run was defined as a continuous sequence of capacity exceedances lasting more than 24 h, i.e., at least 25 consecutive hourly observations. For each station, the number of long exceedance runs, their total duration, and the maximum run duration were recorded. These diagnostics were not used as model inputs; they were used only to document data quality and ensure preprocessing reproducibility.
After physical screening, missing values were handled using controlled imputation. First, short missing gaps were filled by time-based linear interpolation along the datetime index. Interpolation was restricted to gaps of at most 24 consecutive hours (Equation (7)):
where
is the interpolated hourly value and
denotes time-based linear interpolation along the datetime index. Equation (7) restores continuity for short telemetry interruptions while avoiding artificial bridging across long outages or structural operational changes.
Remaining missing values were then filled using a rolling median computed over a 7-day window. Since the data are hourly, the window length was as shown in Equation (8):
where
is the rolling-median window length. Boundary values that could not be filled by interpolation or rolling median were filled using forward/backward filling. This final step was used only to avoid edge-related missing values after the main controlled imputation procedure. The number of missing values before QC, after QC, and after imputation was recorded for each station.
Figure 2 presents the post-QC hourly generation series after physical screening and controlled imputation. The purpose of this figure is both descriptive and diagnostic: it shows that the preprocessing procedure removes non-physical artifacts while preserving station-specific operating regimes, seasonal variability, and genuine low-generation periods.
The final hourly dataset was aggregated to daily resolution for forecasting. Daily generation was computed as the mean of QCed hourly generation values (Equation (9)):
where
is daily generation for station
on day
, and
denotes the hourly value after QC and imputation. Daily temperature and SWE were treated as state-like descriptors and aggregated using daily averages. Precipitation was aggregated consistently with the harmonized ERA5-derived representation after correcting for replicated sub-daily values. The resulting daily dataset for 2020–2024 was used for all forecasting experiments.
To make the preprocessing auditable, the revised manuscript reports QC diagnostics in the main text, including maximum power before and after QC, number and share of values exceeding 105% of installed capacity, maximum exceedance percentage, long exceedance run diagnostics, NaN counts before QC, NaN counts after QC, and NaN counts after imputation.
2.3. Feature Engineering, Water-Level Ablation, Models, and Evaluation Protocol
For each station, the predictor matrix combined autoregressive generation information with exogenous hydro-meteorological predictors. The base predictor set included daily generation, air temperature, precipitation, and snow water equivalent (SWE). Lagged and rolling features were constructed only from information available at the forecast origin, ensuring that no future observations entered the predictor matrix.
For a base date
, the meteorological lag block is represented as
(Equation (10)):
where
denotes the meteorological feature block for station
at forecast origin
,
denotes daily air temperature,
denotes daily precipitation,
denotes daily snow water equivalent,
is the lag index, and
is the selected lookback depth. The lookback depth was selected using validation data only. Candidate lookback depths were evaluated on the 2023 validation period, and the final configuration was chosen according to validation NSE. The independent 2024 test period was not used for lookback selection.
The lookback depth was selected through a unified validation-based grid-search procedure. For all model families and all hydropower plants, the same candidate lookback set was evaluated: L = {7, 14, 21, 28, 35} days. This ensured that all models were compared under consistent temporal-search conditions. For each station–model pair, the value of L that achieved the best validation NSE-based performance on the 2023 validation period was selected and then fixed for the independent 2024 test evaluation. The selected lookback depths and the corresponding validation NSE scores are reported in
Table 2.
For ML/DL models, the selected lookback depth L defined the full historical predictor window used to construct the input matrix. This window included autoregressive generation, air temperature, precipitation, SWE, and the optional water-level input where retained. Therefore, meteorological predictors and autoregressive generation were evaluated within the same candidate historical windows rather than being tuned using separate or inconsistent lag structures.
For SARIMAX, the same candidate lag depths L = {7, 14, 21, 28, 35} were evaluated for the exogenous hydro-meteorological regressors, while the endogenous temporal dependence of daily generation was represented through the selected non-seasonal and seasonal SARIMA orders. Thus, the final configuration for each model was selected using the same validation period and the same candidate lookback range. The selected configuration was then kept unchanged for the independent 2024 test evaluation.
Table 2 shows that the selected memory depth differed both across stations and across model classes. This confirms that a single fixed lookback depth would not be appropriate for the analyzed hydropower system. For example, Kask frequently selected short memory depths of 7–14 days, whereas Shulb, Moin, and several neural network configurations required longer windows of 28–35 days. This variability is consistent with the heterogeneous operating regimes of the stations, including reservoir regulation, cascade effects, mountain-fed runoff, and snow-melt-related seasonal memory. The validation-based selection procedure therefore allowed each station–model pair to use the memory structure that was most informative on the 2023 validation period, while preserving a fully independent 2024 test evaluation.
River water level was treated as an optional exogenous predictor rather than a mandatory input for all stations. This decision was motivated not only by differences in predictive contribution, but also by differences in observational availability and hydrological representativeness. In particular, water-level measurements were not available for all plants from gauging stations located directly within the most relevant river reach controlling the hydropower inflow regime. For several stations, no hydrological post was available at the required hydraulic section, and the closest available regional gauging station had to be used as a proxy. Consequently, the informative value of water-level observations was expected to vary across stations depending on gauge placement, river regulation effects, and the degree to which the selected gauge reflected local hydrological conditions at the plant.
Where available, water-level series were collected over the full 2020–2024 study period and incorporated into the candidate predictor pool. However, to avoid test-driven feature selection, the decision to retain or exclude water level was made exclusively using the 2023 validation period. For each station, two otherwise identical configurations were compared:
, a model without water level, and
, a model with water level. The validation gain from water-level inclusion was computed as
(Equation (11)):
where
denotes the validation gain for station
,
is the validation NSE obtained when the water level is included, and
is the validation NSE obtained without the water level.
The water level was retained only when ΔNSE > 0.01. This threshold was introduced to avoid adding an extra exogenous predictor when the validation gain was negligible or likely attributable to numerical noise. The corresponding station-specific validation results and final USE/DROP decisions are summarized in
Table 3. The independent 2024 test period was not used for this decision.
To keep the feature selection procedure transparent, leak-free, and comparable across models, water-level ablation was performed once on the 2023 validation period using Ridge regression (or Tikhonov regularization) as a parsimonious regularized linear reference model [
39,
40]. The resulting station-specific USE/DROP decision was then fixed and applied consistently to all downstream models. In this way, water-level inclusion was treated as a validation-based feature-selection step rather than as a model-specific hyperparameter, thereby avoiding unequal tuning effort across methods and preserving a fair comparison on the independent 2024 test set.
The ablation results show that water level was not uniformly beneficial across stations. A positive and practically meaningful validation gain was observed for Bukhtarma (), Moinak (), and Kaskad Almaty (); therefore, water level was retained for these stations. For Shulbinsk, Ust-Kamenogorsk, Leninogorsk, and Shardara, including water level reduced validation NSE. For Kapchagay, the gain was positive but negligible () and below the predefined threshold; therefore, water level was not retained.
This station-specific behavior is physically plausible. In regulated hydropower systems, generation is not determined by river stage alone. It also depends on dispatch decisions, turbine availability, reservoir operation, cascade coordination, and plant-specific constraints. Therefore, a water-level gauge provides useful information only when it is sufficiently representative of the hydrological conditions controlling generation at a given plant. In other stations, water level may be redundant with autoregressive generation features, weakly synchronized with the target, affected by regulation, or too noisy to improve validation performance. For this reason, enforcing water level as a universal predictor would reduce model robustness and make the comparison less meaningful.
The model set included representative linear, statistical, tree-based, and neural approaches: Linear Regression (LR), SARIMAX, Random Forest (RF), Histogram Gradient Boosting Regressor (HGBR), Multilayer Perceptron (MLP), and Long Short-Term Memory (LSTM). In the revised experiments, operational baseline was also included to strengthen the interpretation of model skill. The Persistence baseline was defined as the most recent available daily generation value at the forecast origin (Equation (12)):
where
denotes the Persistence forecast for station
, forecast origin
, and lead time
, and
is the observed daily generation at the forecast origin.
All experiments followed a strict chronological split: 2020–2022 for training, 2023 for validation and model selection, and 2024 for independent testing. Hyperparameters, lookback depth, water-level inclusion, and model-selection decisions were made exclusively on the validation period. After selection, final models were retrained on the combined training and validation data and evaluated once on the independent 2024 test period. This design prevents data leakage and approximates real operational deployment conditions.
Model performance was evaluated using Nash–Sutcliffe efficiency (NSE), root mean squared error (RMSE) and mean absolute error (MAE). NSE was computed as in Equation (13):
where
is the observed value,
is the predicted value,
is the mean observed value over the evaluation sample, and
is the number of evaluated samples.
RMSE and MAE were computed as in Equations (14) and (15):
and:
NSE was used as the primary performance metric because it is widely used in hydrological forecasting and provides an efficiency-based measure relative to the variance in the observed series. RMSE and MAE were reported alongside NSE to preserve engineering interpretability in MW.