Next Article in Journal
Quality Assessment of Small Urban Catchments Stormwater Models: A New Approach Using Old Metrics
Next Article in Special Issue
Towards Informed Water Resources Planning and Management
Previous Article in Journal
Nitrogen Treatment by a Dry Detention Basin with Stormwater Wetland Characteristics
Previous Article in Special Issue
Effective Transfer of Science to Operations in Hydrometeorology Considering Uncertainty
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Climate Extrapolations in Hydrology: The Expanded Bluecat Methodology

by
Demetris Koutsoyiannis
1,* and
Alberto Montanari
2
1
Department of Water Resources and Environmental Engineering, School of Civil Engineering, National Technical University of Athens, Heroon Polytechneiou 5, GR-157 80 Zographou, Greece
2
Department of Civil, Chemical, Environmental and Materials Engineering (DICAM), University of Bologna, Via del Risorgimento 2, 40136 Bologna, Italy
*
Author to whom correspondence should be addressed.
Hydrology 2022, 9(5), 86; https://doi.org/10.3390/hydrology9050086
Submission received: 26 April 2022 / Revised: 6 May 2022 / Accepted: 10 May 2022 / Published: 12 May 2022
(This article belongs to the Collection Feature Papers of Hydrology)

Abstract

:
Bluecat is a recently proposed methodology to upgrade a deterministic model (D-model) into a stochastic one (S-model), based on the hypothesis that the information contained in a time series of observations and the concurrent predictions made by the D-model is sufficient to support this upgrade. The prominent characteristics of the methodology are its simplicity and transparency, which allow its easy use in practical applications, without sophisticated computational means. In this paper, we utilize the Bluecat methodology and expand it in order to be combined with climate model outputs, which often require extrapolation out of the range of values covered by observations. We apply the expanded methodology to the precipitation and temperature processes in a large area, namely the entire territory of Italy. The results showcase the appropriateness of the method for hydroclimatic studies, as regards the assessment of the performance of the climate projections, as well as their stochastic conversion with simultaneous bias correction and uncertainty quantification.

1. Introduction

Hydrologists often need to consider in their studies climate projections for the future. Such need comes from concerns about the future climate, the idea that “stationarity is dead” [1] (which has, however, been disputed, e.g., [2,3]), and the obligation to use climate predictions for the technical design of climate adaptation strategies. There is no doubt that the future climate will change (as ever) and, therefore, the assessment of the technical performances of climate models at local temporal and spatial scales is an important research topic [4,5,6,7,8,9,10].
For the above reasons, methods for extracting useful technical information from climate models are attracting increasing attention. In this respect, Tyralis and Koutsoyiannis [11] have developed a Bayesian methodology for extracting such information and providing a stochastic framework of the future climate based on observations, on the one hand, and conditional on climate model outputs, on the other hand.
However, this methodology is rather complicated, which prohibits its use by practitioners. In this paper, we provide a simple methodology that can be applied without sophisticated computational means. The methodology stems from hydrological modelling—in particular from deterministic hydrological models that are upgraded to stochastic ones (see Section 2). In this study, we illustrate the methodology in hydroclimatic applications, in which the deterministic models are climate models (also known as general circulation models), while the stochastic model is built upon reanalysis data representing reality; both model outputs and reanalysis data are readily provided on the internet (Section 3). Climate models provide outputs for atmospheric variables, such as temperature and precipitation, which, in turn, are used as inputs in hydrological modelling. Therefore, the usefulness of the study relies on (a) the assessment of how well climate model outputs represent reality, (b) the correction of the model outputs to approach reality, (c) the assessment of the involved uncertainty by means of comparing model outputs to reality (instead of the more common practice of comparing different models with each other), and (d) the potential of supporting the construction of a stochastic representation of climate inputs for use in hydrologic modelling. This usefulness with respect to items (a)–(c) is illustrated by the application of the methodology to a large area, namely, the entire territory of Italy (Section 4), while a study focused on item (d) is planned for future research.

2. Bluecat and Its Expansion to Deal with Climate Projections

Hydrological models are transformations of inputs x τ (e.g., rainfall) at a discrete time τ to outputs Q τ (e.g., river discharge) by means of a model, expressed as:
Q τ = G ( x τ )
where x τ is a vector containing a number of consecutive input variables, or even a matrix consisting of several input variables (such as rainfall, evapotranspiration and perhaps river discharge in an upstream basin). The transformation function is generally a complicated one, also involving additional state variables (e.g., soil moisture).
Climate models do not differ from this logic, even though they are much more complicated. A model is never identical to reality and, thus, the true value of the output q τ is different from the model prediction Q τ .
In their blueprint, Montanari and Koutsoyiannis [12] provided a framework to upgrade a deterministic model into a stochastic one, which provides the probability distribution of the output given the inputs and the deterministic model output, considering the uncertainty in the model parameters and in input variables. This work has been discussed [13,14] and advanced in other studies [15,16,17].
In a recent follow-up paper, Koutsoyiannis and Montanari [18] proposed a simple, easy-to-use and transparent methodology to upgrade a deterministic model into a stochastic one based on the data only, which they named Bluecat. The basic hypothesis is that the information contained in the true outputs q τ and the concurrent predictions by the deterministic model Q τ is sufficient to support this upgrade. Simplicity is a primary objective of this methodology, which does not involve multiple simulations, likelihood estimation, Bayesian methods, etc. Rather, it uses a computational framework that can run even in a worksheet software. In this paper, we utilize this latter methodology and expand it in order to be combined with climate model outputs, which often require extrapolation out of the range of values covered by observations. The need for extrapolation emerges when projections to future time periods are of interest and, in particular, when modelling includes atmospheric temperature, for which almost all climate models suggest a future increase.
In upgrading a deterministic model into a stochastic one, all related quantities should be regarded as stochastic (random) variables and their sequences as stochastic processes. For notational clarity, we underline stochastic variables, stochastic processes and stochastic functions. We use non-underlined symbols for regular variables and deterministic functions, as well as for realizations of stochastic variables and of stochastic processes, where the latter realizations are also known as time series.
We assume that the inputs x _ τ , at discrete times τ , have a stationary probability density function f x ( x ) and distribution function F x ( x ) . The output q _ τ depends on the inputs x _ τ and is given though some stochastic function (S-model) as:
q _ τ = g _ ( x _ τ )
The stochastic process q _ τ is assumed to correspond to the real process, while the outcome of the deterministic model (D-model) of Equation (1) is an estimate thereof. By writing the latter equation in stochastic terms, retaining, however, the function G   ( g _ ) as a deterministic function, we obtain the estimator Q _ τ of the output q _ τ as:
Q _ τ   : = G ( x _ τ )
To advance from the D-model, in its form (3), to the S-model in (2), we just need to specify the conditional distribution:
F q | Q ( q | Q ) = P { q _ q | Q _ = Q }
with q and Q assumed to be concurrent and referring to discrete time τ . In other words, in this paper, conditioning is meant in scalar setting. An extension where Q is a vector containing the current and earlier predictions by the D-model is possible, but more laborious, thus not complying with our simplicity target.
It is relatively easy to infer from data the marginal distribution and density functions of the S-variable q _ and D-predicted variable Q _ . Therefore, we may assume that f q ( q ) and f Q ( Q ) are known. Specifically, if we have a time series of concurrent Q and q , each of size n , and if Q ( i : n ) is the ith smallest value in the time series of Q and q ( j : n ) is the jth smallest value in the time series of q , then we can use the approximations:
F Q ( Q ( i : n ) ) i 0.439 n + 0.123 ,     F q ( q ( j : n ) ) j 0.439 n + 0.123
which provide an unbiased estimate of the logarithm of the excess return period, or, equivalently, the quantity ln ( F / ( 1 F ) ) (adapted from Koutsoyiannis [19], Table 5.5).
Then, the conditional density sought should obey [18]:
f q | Q ( q | Q ) d q = 1 ,     0 1 f q | Q ( q | F Q 1 ( z ) ) d z = f q ( q ) ,     0 1 F q | Q ( q | F Q 1 ( z ) ) d z = F q ( q )
However, determining F q | Q ( q | Q ) from the data alone without assuming a specific expression for the distribution is not that easy. As the variables of interest are usually of continuous type, we may expect that each value Q τ in the available time series appears only once. Thus, we cannot form a sample for a particular value of Q . Koutsoyiannis and Montanari [18] proposed the following simple approximation of F q | Q ( q | Q ) , by using a sample of Q-neighbours:
F q | Q ( q | Q ) = P { q _ q | Q _ = Q } P { q _ q | Q Δ Q 1 Q _ Q + Δ Q 2 }   = P { q _ q | F Q ( Q ) Δ F 1 F Q ( Q _ ) F Q ( Q ) + Δ F 2 } = :   F q | [ Q ] ( q | Q , Δ F 1 , Δ F 2 )
where the increments Δ Q i and Δ F i can be chosen based on the requirement that the intervals below and above the values Q (or F Q ( Q ) ) contain appropriate numbers of data values, m 1 : = Δ F 1 n and m 2 : = Δ F 2 n , respectively. The numbers m 1 and m 2 should not be too large, so that F Q ( Q ) ± Δ F 1 , 2 be close to F Q ( Q ) , nor too small, so that the probability P { q _ q | F Q ( Q ) m 1 / n F Q ( Q _ ) F Q ( Q ) + m 2 / n } can be estimated empirically, from a sample of size m 1 + m 2 + 1 , as reliably as possible. Koutsoyiannis and Montanari [18] generally used Δ F 1 = Δ F 2 = Δ F and, hence, m 1 = m 2 = m , except for the m lowest and the m highest values of Q , for which they developed a special procedure, which nonetheless is not able to extrapolate beyond the lowest and highest Q values.
In this paper, we modify the procedure, with the aim to extrapolate beyond the range of Q values. First, we generalize the use of equal sizes of the left and right subsamples, i.e., m 1 = m 2 = m , so that the subsample [ Q ] always have size 2 m + 1 . Similar to Equation (5),
F q ( i : 2 m + 1 ) | [ Q ] ( q | Q ) = i 0.439 2 m + 1 + 0.123
For example, setting m = 50 , i.e., 2 m + 1 = 101 , the lowest empirical probability we can estimate would be 0.55 % and the highest one would be 99.45 % for i = 1 and 101, respectively. However, these estimates are too uncertain; a more reasonable choice for m = 50 would be i = 5 and 97, resulting in probability estimates 4.5 % and 95.5 % , respectively.
Apparently, this procedure cannot work for Q < Q ( m + 1 : n ) and Q > Q ( n m : n ) . For these cases, we choose a constant c 1 , so that Q ( m + 1 : n ) c Q Q ( n m : n ) and estimate the conditional distribution by enrolling the relationship
F q | Q ( q | Q ) F q | Q ( q + a ( 1 1 / c ) c Q | c Q )
where a is a parameter representing a regression slope between Q and q . It can be shown that Equation (9) is precisely valid if the process of interest is Gaussian. If not, it can be used as an approximation. The approximation can be improved by transforming the processes to Gaussian, e.g., using the transformation
q = λ ln   ( 1 + q λ )  
where q and q are original and transformed variables, respectively (and likewise for Q ), and λ is a parameter. For λ and λ 0 , Equation (10) becomes equivalent to the identity and the logarithmic transform, respectively. Yet, in comparison to the standard logarithmic transform, Equation (10) has the advantage that it maps zero to itself.
If Q L and Q H are the lowest and highest values for which estimates are sought; then, we define two values c L and c H , so that c L Q L = Q ( m + 1 : n ) ,   c H Q H = Q ( n m : n ) . Likewise, we estimate two values (slopes) a L and a H by regression on the lowest and highest part (say quarter or third) of the entire sample of size n . Using the values c L ,   c H ,   a L , a H along with Equation (9), we are able to extrapolate below and above the values Q ( m + 1 : n ) and Q ( n m : n ) , respectively.
Bluecat has been tested in synthetic cases with a priori known conditional and marginal distributions [20] as well as in real-world hydrological modelling cases [18]. The results have been satisfactory as it always succeeds in its two targets, namely:
  • To appropriately correct the D-model bias, which may differ for different ranges of Q ;
  • To infer the model uncertainty in terms of confidence bands, whose width may also differ for different ranges of Q .
A schematic representation of the expanded Bluecat method is shown in Figure 1.

3. Data

To apply Bluecat in combination with climate models, we chose as a case study area the entire territory of Italy. The reason we chose a big area, rather than a more hydrologically relevant unit, such as a specific catchment, is the known fact [8,10] that the performance of climate models improves by increasing the spatial scale. As case study variables of hydrological interest, we chose temperature and precipitation, both averaged in terms of area across the entire Italian territory.
As actual values of the processes of interest, we regarded those provided by the NCEP-NCAR Reanalysis 1 [21], jointly produced by the National Centers for Environmental Prediction (NCEP) and the National Center for Atmospheric Research (NCAR). Its temporal coverage includes 4-times daily, daily and monthly values from 1948 to the present at a horizontal resolution of 1.88° (~210 km at the equator). It uses a state-of-the-art analysis/forecast system to perform data assimilation using observations and a numerical weather prediction model. The data assimilation and the model used are identical to the global system implemented operationally at NCEP, except in the horizontal resolution. A large subset of these data is available as daily and monthly averages (https://www.esrl.noaa.gov/psd/cgi-bin/data/testdap/timeseries.pl; accessed on 25 February 2022). The data were retrieved from the climexp platform (http://climexp.knmi.nl/, section: monthly reanalysis fields; accessed 25 on February 2022), using as a geographical mask that of Italy, readily provided by the platform. The time series are plotted in Figure 2 (temperature) and Figure 3 (precipitation) for their entire time period (1948–2021).
As a deterministic model, we used the mean of the output data of the Coupled Model Intercomparison Project (CMIP6), noting that nothing would change in the methodology if we chose any particular member of the ensemble instead of the mean. Among the scenarios provided, we use the Scenario Shared Socio-Economic Pathways 245 (SSP245). The model outputs also go back to the past, extending over the time period of 1850–2100. They have again been accessed through the climexp platform (option: Monthly CMIP6 scenario runs; Case: CMIP6 mean).
A comparison of the model outputs for temperature is shown in Figure 2 for the common period of the datasets. In the upper panel, depicting the monthly data, it appears that the model agrees well with the actual temperature, with a very high coefficient of determination ( R 2 = 0.96 ). This results from the fact that the model captures the annual periodicity, as materialized at the specific geographical location of Italy. If we average the process at the annual scale to eliminate the effect of periodicity (middle panel), then the agreement between the two datasets deteriorates ( R 2 = 0.26 ). In particular, in recent years, the models predicted a considerable temperature increase, which however does not correspond to reality. The lower panel of the Figure 2 also shows a comparison after reducing the effect of periodicity, but at the monthly scale; this was performed by subtracting the original values from the actual monthly means. Now, the D-model data show little correspondence to reality ( R 2 = 0.03 ). Yet, the Bluecat method can be applied without problems, as it has been tested even with D-models that are irrelevant to reality. Specifically, it was demonstrated [20] that, even in this case, Bluecat corrects the bias and properly evaluates uncertainty (which obviously is high, if the D-model is irrelevant to reality).
Likewise, Figure 3 shows similar comparisons for precipitation. Now, the agreement of D-model with reality is poor both on the annual and the monthly scale ( R 2 = 0.03 ). In particular, at the monthly scale, the D-model exhibits very low variability and, at the annual scale, it shows a horizontal line of stagnancy, which is different from what actually happens.

4. Results

For the temperature case, we applied Bluecat to the monthly differences from the means to avoid the construction of a more complex cyclostationary version of Bluecat, which would substantially reduce the available size of the dataset (e.g., in a monthly cyclostationary model, we would have 1/12 of the data for each month). Figure 4 shows the results of the application of Bluecat to the temperature data. The graph depicts the true value and the S-prediction in terms of confidence limits vs. the D-prediction. The median S-prediction is also shown. The confidence limits are for a confidence coefficient of 90% ( F = 0.05   and   0.95 for the low and high prediction, respectively). With reference to Equation (8), to estimate the value corresponding to a certain F , we solved the equation for i and rounded it to the nearest integer, and then calculated the q value as that corresponding to the ith smallest value in the sample of 2 m + 1 values. If the D-model was a good representation of reality, the median line would be close to the equality line and the confidence band would be narrow. In contrast, a totally irrelevant representation would result in a horizontal straight line with a wide confidence band. Here the situation is in between these two extreme cases. Yet, the performance of the D-model is not very good as the equality line is not enveloped by the confidence limit for high Q-predictions.
Therefore, as shown in Figure 5, the evolution resulting from the S-model is quite different from that of the D-model. In the upper panel of the figure, it is seen that the increase rate of the future temperature according to the S-model is smaller than that predicted by the D-model. The reason why this happens becomes obvious in the lower panel of the figure, which focuses on recent years. Specifically, in the past ten years, the D-model has already departed from reality and, therefore, the departure increases in the future. This behaviour has recently been called the hot model problem [22], and, as seen in the rightmost area of the graph in Figure 5, it is properly resolved by the S-model of Bluecat.
Another notable feature in Figure 5 is the zig-zag shape of all predictions (D and S). This can easily be attributed to the excessive intensity of periodicity in the D-model. A simple remedy of this problem is shown in Figure 6, where the monthly S-model values have been replaced by running averages with a 12-month time step.
One might potentially think to attribute the difference of the temperature increase rates of the D-model and S-model to the fact that the latter is stationary, while the former is not. However, this is not the case. The actual reason of the difference is the departure of the model from reality in the latest period. It is easy to demonstrate that Bluecat would behave well if the D-model had a better performance, which means that its stationary formulation is not a problem. This is graphically depicted in Figure 7 (upper panel), where to make the D-model closer to reality, we replaced the D-model series with the weighted sum of true and D-model values with weights of 0.75 and 0.25, respectively. As seen in the figure, in this case, the S-model remains very close to the D-model even in the distant future (2100). While the entire methodology is based on stationarity, it captures the trendy shape of the D-model, provided that the latter is close to reality.
For the completeness of the investigation, the lower panel of Figure 7 depicts a case where the D-model is totally irrelevant to reality. To implement this hypothetical case, we reordered the D-model series at random, so as to become uncorrelated to the true values. As expected, in this case, the S-model in effect disregards the D-model, producing horizontal lines of the future evolution, as expected for a stationary model. Even by disregarding the D-model, the S-model provides useful information, which is the stationary distribution function of the predictand.
For the precipitation case, in which the seasonal variation in Italy is not prominent, we applied Bluecat to the original monthly values. A second difference from the temperature case is that the rainfall distribution is far from normal and, therefore, we used the transformation of Equation (10) to normalize it. The resulting value of parameter λ is 2 mm and the transformation, indeed, yielded a perfect fit to the Gaussian distribution. Figure 8 shows the results of the application of Bluecat to the transformed precipitation data. The graph depicts the true value and the S-prediction in terms of confidence limits vs. the D-prediction. Notice that the ranges shown in both the horizontal and the vertical axes are intentionally identical. The fact that the true values cover the entire range, while the D-prediction values cover only a small portion of that range, is a result of the poor performance of the D-model. The median S-prediction is also shown, while the confidence limits are again for a confidence coefficient of 90% ( F = 0.05   and   0.95 for the low and high prediction, respectively). It is seen in the figure that, for low precipitation values, the D-model is poor—the median S-model prediction is flat—but this improves for the highest predicted precipitation values, where the median line is close to the equality line. As already discussed (Figure 3), the D-model underpredicts the actual variability of precipitation. Clearly, as shown in Figure 8, this is corrected by Bluecat (compare the ranges of the plotted values on the horizontal and vertical axes).
The evolution resulting from the S-model is shown in Figure 9, after back-transforming to the natural rainfall vales. The substantial effect of the S-model, in this case, is that it widened the range of variability and corrected the bias. Generally, the D-model did not provide any substantial information and, even if we disregarded it, the results would not differ much. It must be further noted that, as the required range for extrapolation is not wide (see the vertical dotted lines in Figure 8), even without using the normalizing transformation, the results are practically the same (not included in figures as the lines would be indistinguishable from those already shown).

5. Discussion and Conclusions

The Bluecat methodology, which was initially proposed as a hydrological modelling tool, appears to provide scientific means for incorporating climate predictions within hydrological modelling. Its theory is simple, transparent and easily understandable. Its key characteristic is the inference of the conditional distribution F q | Q ( q | Q ) = P { q _ q | Q _ = Q } , where Q is the prediction of a deterministic model (D-model—in our case, the climate model) and q is the true value of the predicted quantity. This conditional distribution is tantamount to a stochastic representation (S-model) of the true value. The advance from the D-model to the S-model offers two important functions:
  • It appropriately corrects the D-model bias.
  • It infers the model uncertainty in terms of confidence bands.
Both the bias and the uncertainly characterization may differ for different ranges of Q , where the differences are automatically captured by the S-model by its construction. The conditional distribution is inferred from merely the data, i.e., concurrent values of model outputs Q and true values q . The assumptions for inferring F q | Q ( q | Q ) from the set of concurrent pairs (“observations”) of values ( q τ ,   Q τ ) are the following:
  • If the conditioning value Q lies within the range of “observations”, the conditional distribution is inferred using a subset of pairs ( q , Q ) with adjacent Q values. Namely, those pairs satisfying Q Δ Q 1 Q _ Q + Δ Q 2 are chosen, where Δ Q 1 and Δ Q 2 are properly specified to form a sample of pairs ( q , Q ) that allows the empirical estimation of the conditional probabilities F q | Q ( q | Q ) P { q _ q | Q Δ Q 1 Q _ Q + Δ Q 2 } .
  • Otherwise, an extrapolation is made by the following method: A constant c 1 is chosen so that c Q lie within the range of “observations” and the above method be applicable by replacing or Q with c Q . Then, the conditional distribution is estimated by enrolling the relationship F q | Q ( q | Q ) F q | Q ( q + a ( 1 1 / c ) c Q | c Q ) , where a is a parameter representing a regression slope between Q and q . This parameter is locally determined for the high or low values of Q , depending on the direction of the extrapolation.
The application of the expanded Bluecat method is also very simple as it does not require any sophisticated computational means. All these characteristics make Bluecat an ideal tool for enhancing collaboration of scientists with practitioners and decision makers.
Traditionally, the task of combining climate models within hydrology is termed “downscaling”, as hydrological models require finer scales than those resolved in climate models. An additional (and most important) job of the downscaling techniques is to adjust climate model outputs (such procedures are sometimes termed “bias correction” of statistics), making them consistent with local measurements. In this, downscaling techniques resemble the proposed method. However, our method has substantial differences from downscaling techniques, including the following:
  • The scales of the application of the Bluecat’s S-model are not necessarily different from that of the climate D-model. They could be precisely the same, as in the present application to Italy. In this respect, Bluecat makes the D-model consistent with reality irrespective of spatial scale. Apparently, the case where the scales are different (e.g., smaller area of the S-model with respect to that corresponding to the D-model) is also served by the proposed methodology, without any change with respect to what is described above.
  • The Bluecat methodology considers both the time sequence and the amplitude of the D-model and actual series. It does not make a lumped fitting on the entire set of past data to find unique parametric relationships to be applied to the adaptation of the future values (as usually conducted in downscaling techniques). Nor does it regard the future values as correct ones that only need downscaling. Rather, it treats past and future values produced by the D-model in the same manner—as representing a model and not the truth.
  • In addition to modifying a D-model series, correcting it for bias, Bluecat advances it to a stochastic representation, thus characterizing the uncertainty that is illustrated in this paper in terms of confidence bands.
In fact, the stochastic representation is much more than drawing confidence bands. Its real power emerges in stochastic simulation, by which a system can be tested in a Monte Carlo approach so that the uncertainty of the process of actual interest (e.g., river stage or discharge, reservoir outflow and inundated area) is eventually evaluated. This has not been included in the scope of this paper, but is currently under research, whose results will be reported in the future.
Some features of the Bluecat framework have not been included in this study in order to keep it as simple as possible. These features include a more sophisticated calibration approach, relying on a split-sample technique with different calibration and validation periods, which was not necessary in this paper. Additionally, they include the concept of knowable moments (K-moments [19]) for a more robust estimation of empirical distribution quantiles, while it is also useful for the construction of a simulation framework.

Author Contributions

Conceptualization, D.K. and A.M.; methodology, D.K. and A.M.; software, D.K. and A.M.; validation, D.K. and A.M.; formal analysis, D.K. and A.M.; investigation, D.K. and A.M.; resources, D.K. and A.M.; data curation, D.K. and A.M.; writing—original draft preparation, D.K. and A.M.; writing—review and editing, D.K. and A.M.; visualization, D.K. and A.M.; supervision, D.K. and A.M.; project administration, D.K. and A.M. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding but was conducted for scientific curiosity.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data used in the study are freely available and, as described in the article, they were retrieved from the climexp platform. The NCEP–NCAR reanalysis data are described in https://www.esrl.noaa.gov/psd/cgi-bin/data/testdap/timeseries.pl (accessed on 25 February 2022). The Coupled Model Intercomparison Project (CMIP6) model data are produced by CSIRO is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License (https://creativecommons.org/licenses/; accessed on 25 February 2022). The data were processed and the results were produced by a common (commercial) spreadsheet software. An example spreadsheet file is available upon request from the authors.

Acknowledgments

We thank Ezio Todini and Tammo Steenhuis for the honourable invitation of this article. We are grateful to the organizations and colleagues who made available on the internet the datasets we used and the platforms to process them. We are grateful to two anonymous reviewers for their constructive comments that helped to improve the presentation of the study.

Conflicts of Interest

We declare no conflict of interest. We believe that anonymous reviewing may hide possible conflicts of interest and, hence, we favour eponymous reviewing.

References

  1. Milly, P.C.D.; Betancourt, J.; Falkenmark, M.; Hirsch, R.M.; Kundzewicz, Z.W.; Lettenmaier, D.P.; Stouffer, R.J. Stationarity is dead: Whither water management? Science 2008, 319, 573–574. [Google Scholar] [CrossRef] [PubMed]
  2. Montanari, A.; Koutsoyiannis, D. Modeling and mitigating natural hazards: Stationarity is immortal! Water Resour. Res. 2014, 50, 9748–9756. [Google Scholar] [CrossRef]
  3. Koutsoyiannis, D.; Montanari, A. Negligent killing of scientific concepts: The stationarity case. Hydrol. Sci. J. 2015, 60, 1174–1183. [Google Scholar] [CrossRef]
  4. Padrón, R.S.; Gudmundsson, L.; Seneviratne, S.I. Observational constraints reduce likelihood of extreme changes in multidecadal land water availability. Geophys. Res. Lett. 2019, 46, 736–744. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Moon, H.; Gudmundsson, L.; Seneviratne, S.I. Drought persistence errors in global climate models. J. Geophys. Res. Atmos. 2018, 123, 3483–3496. [Google Scholar] [CrossRef] [PubMed]
  6. Koutsoyiannis, D.; Efstratiadis, A.; Georgakakos, K. Uncertainty assessment of future hydroclimatic predictions: A comparison of probabilistic and scenario-based approaches. J. Hydrometeorol. 2007, 8, 261–281. [Google Scholar] [CrossRef]
  7. Koutsoyiannis, D.; Efstratiadis, A.; Mamassis, N.; Christofides, A. On the credibility of climate predictions. Hydrol. Sci. J. 2008, 53, 671–684. [Google Scholar] [CrossRef]
  8. Anagnostopoulos, G.G.; Koutsoyiannis, D.; Christofides, A.; Efstratiadis, A.; Mamassis, N. A comparison of local and aggregated climate model outputs with observed data. Hydrol. Sci. J. 2010, 55, 1094–1110. [Google Scholar] [CrossRef]
  9. Kundzewicz, Z.W.; Stakhiv, E.Z. Are climate models “ready for prime time” in water resources management applications, or is more research needed? Editorial. Hydrol. Sci. J. 2010, 55, 1085–1089. [Google Scholar] [CrossRef]
  10. Koutsoyiannis, D.; Christofides, A.; Efstratiadis, A.; Anagnostopoulos, G.G.; Mamassis, N. Scientific dialogue on climate: Is it giving black eyes or opening closed eyes? Reply to “A black eye for the Hydrological Sciences Journal” by D. Huard. Hydrol. Sci. J. 2011, 56, 1334–1339. [Google Scholar] [CrossRef] [Green Version]
  11. Tyralis, H.; Koutsoyiannis, D. On the prediction of persistent processes using the output of deterministic models. Hydrol. Sci. J. 2017, 62, 2083–2102. [Google Scholar] [CrossRef]
  12. Montanari, A.; Koutsoyiannis, D. A blueprint for process-based modeling of uncertain hydrological systems. Water Resour. Res. 2012, 48, W09555. [Google Scholar] [CrossRef]
  13. Nearing, G. Comment on “A blueprint for process-based modeling of uncertain hydrological systems” by Alberto Montanari and Demetris Koutsoyiannis. Water Resour. Res. 2014, 50, 6260–6263. [Google Scholar] [CrossRef]
  14. Montanari, A.; Koutsoyiannis, D. Reply to comment by G. Nearing on “A blueprint for process-based modeling of uncertain hydrological systems”. Water Resour. Res. 2014, 50, 6264–6268. [Google Scholar] [CrossRef]
  15. Sikorska, A.; Montanari, A.; Koutsoyiannis, D. Estimating the uncertainty of hydrological predictions through data-driven resampling techniques. J. Hydrol. Eng. (ASCE) 2015, 20, A4014009. [Google Scholar] [CrossRef]
  16. Papacharalampous, G.; Koutsoyiannis, D.; Montanari, A. Quantification of predictive uncertainty in hydrological modelling by harnessing the wisdom of the crowd: Methodology development and investigation using toy models. Adv. Water Resour. 2020, 136, 103471. [Google Scholar] [CrossRef] [Green Version]
  17. Papacharalampous, G.; Tyralis, C.; Koutsoyiannis, D.; Montanari, A. Quantification of predictive uncertainty in hydrological modelling by harnessing the wisdom of the crowd: A large-sample experiment at monthly timescale. Adv. Water Resour. 2020, 136, 103470. [Google Scholar] [CrossRef] [Green Version]
  18. Koutsoyiannis, D.; Montanari, A. Bluecat: A local uncertainty estimator for deterministic simulations and predictions. Water Resour. Res. 2022, 58, e2021WR031215. [Google Scholar] [CrossRef]
  19. Koutsoyiannis, D. Stochastics of Hydroclimatic Extremes—A Cool Look at Risk; Kallipos Open Academic Editions: Athens, Greece, 2021; 333p, ISBN 978-618-85370-0-2. Available online: https://www.itia.ntua.gr/2000/ (accessed on 13 March 2022).
  20. Koutsoyiannis, D.; Montanari, A. A brisk local uncertainty estimator for hydrologic simulations and predictions (blue cat). In Proceedings of the EGU General Assembly Conference Abstracts, Online, 4–8 May 2020; p. 10125. Available online: https://www.itia.ntua.gr/2044 (accessed on 13 March 2022).
  21. Kalnay, E.; Kanamitsu, M.; Kistler, R.; Collins, W.; Deaven, D.; Gandin, L.; Iredell, M.; Saha, S.; White, G.; Woollen, J.; et al. The NCEP/NCAR 40-year reanalysis project. B. Am. Meteorol. Soc. 1996, 77, 437–472. [Google Scholar] [CrossRef] [Green Version]
  22. Hausfather, Z.; Marvel, K.; Schmidt, G.A.; Nielsen-Gammon, J.W.; Zelinkadoi, M. Climate simulations: Recognize the ‘hot model’ problem. Nature 2022, 605, 26–29. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic representation of the expanded Bluecat method.
Figure 1. Schematic representation of the expanded Bluecat method.
Hydrology 09 00086 g001
Figure 2. Comparison of the actual and D-model temperature data: (upper) original monthly data; (middle) after the aggregation to annual scale; (lower) after the subtraction of monthly means to reduce the effect of periodicity.
Figure 2. Comparison of the actual and D-model temperature data: (upper) original monthly data; (middle) after the aggregation to annual scale; (lower) after the subtraction of monthly means to reduce the effect of periodicity.
Hydrology 09 00086 g002
Figure 3. Comparison of actual and D-model precipitation data: (upper) original monthly data; (lower) after aggregation to annual scale.
Figure 3. Comparison of actual and D-model precipitation data: (upper) original monthly data; (lower) after aggregation to annual scale.
Hydrology 09 00086 g003
Figure 4. True values vs. D-model predictions for temperature, along with the S-model predictions (median and 90% confidence limits). The vertical dotted lines define the area out of which extrapolation is necessary.
Figure 4. True values vs. D-model predictions for temperature, along with the S-model predictions (median and 90% confidence limits). The vertical dotted lines define the area out of which extrapolation is necessary.
Hydrology 09 00086 g004
Figure 5. True values and predictions by D-model and S-model (median and 90% confidence limits) of temperature in Italy: (upper) entire period; (middle and lower) focus on 20-year periods.
Figure 5. True values and predictions by D-model and S-model (median and 90% confidence limits) of temperature in Italy: (upper) entire period; (middle and lower) focus on 20-year periods.
Hydrology 09 00086 g005
Figure 6. As Figure 5, but with S-model results (median and 90% confidence limits) replaced by running averages over 12 months.
Figure 6. As Figure 5, but with S-model results (median and 90% confidence limits) replaced by running averages over 12 months.
Hydrology 09 00086 g006
Figure 7. Modified Figure 5 for two hypothetical cases, in which the D-model values are reconstructed so as to be (upper) very close to reality, by replacing the D-model series with the weighted sum of true and D-model values with weights of 0.75 and 0.25, respectively, and (lower) completely irrelevant to reality, by randomly rearranging the time order the true values.
Figure 7. Modified Figure 5 for two hypothetical cases, in which the D-model values are reconstructed so as to be (upper) very close to reality, by replacing the D-model series with the weighted sum of true and D-model values with weights of 0.75 and 0.25, respectively, and (lower) completely irrelevant to reality, by randomly rearranging the time order the true values.
Hydrology 09 00086 g007
Figure 8. True values vs. D-model predictions for precipitation, transformed for normalization, along with S-model predictions (median and 90% confidence limits). The vertical dotted lines define the area out of which extrapolation is necessary.
Figure 8. True values vs. D-model predictions for precipitation, transformed for normalization, along with S-model predictions (median and 90% confidence limits). The vertical dotted lines define the area out of which extrapolation is necessary.
Hydrology 09 00086 g008
Figure 9. True values and predictions by D-model and S-model (median and 90% confidence limits) of precipitation in Italy: (upper) entire period; (middle and lower) focus on 20-year periods. (Nb. A normalizing transformation by Equation (10) with λ = 2 mm/d is used, while the plotted values are back transformed).
Figure 9. True values and predictions by D-model and S-model (median and 90% confidence limits) of precipitation in Italy: (upper) entire period; (middle and lower) focus on 20-year periods. (Nb. A normalizing transformation by Equation (10) with λ = 2 mm/d is used, while the plotted values are back transformed).
Hydrology 09 00086 g009
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Koutsoyiannis, D.; Montanari, A. Climate Extrapolations in Hydrology: The Expanded Bluecat Methodology. Hydrology 2022, 9, 86. https://doi.org/10.3390/hydrology9050086

AMA Style

Koutsoyiannis D, Montanari A. Climate Extrapolations in Hydrology: The Expanded Bluecat Methodology. Hydrology. 2022; 9(5):86. https://doi.org/10.3390/hydrology9050086

Chicago/Turabian Style

Koutsoyiannis, Demetris, and Alberto Montanari. 2022. "Climate Extrapolations in Hydrology: The Expanded Bluecat Methodology" Hydrology 9, no. 5: 86. https://doi.org/10.3390/hydrology9050086

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop