Next Article in Journal
Turbulent Flow Structures and Scour Hole Characteristics around Circular Bridge Piers over Non-Uniform Sand Bed Channels with Downward Seepage
Next Article in Special Issue
Application of the Iterative Ensemble Smoother Method and Cloud Computing: A Groundwater Modeling Case Study
Previous Article in Journal
On Complex Network Construction of Rain Gauge Stations Considering Nonlinearity of Observed Daily Rainfall Data
Previous Article in Special Issue
Hydrogeological Bayesian Hypothesis Testing through Trans-Dimensional Sampling of a Stochastic Water Balance Model
Open AccessFeature PaperArticle

Making Steppingstones out of Stumbling Blocks: A Bayesian Model Evidence Estimator with Application to Groundwater Transport Model Selection

by Ahmed S. Elshall 1,2 and Ming Ye 3,*
1
Department of Earth Sciences, University of Hawai‘i Manoa, Honolulu, HI 96822, USA
2
Water Resources Research Center, University of Hawai‘i Manoa, Honolulu, HI 96822, USA
3
Department of Earth, Ocean, and Atmospheric Science, Florida State University, Tallahassee, FL 32306, USA
*
Author to whom correspondence should be addressed.
Water 2019, 11(8), 1579; https://doi.org/10.3390/w11081579
Received: 16 June 2019 / Revised: 19 July 2019 / Accepted: 28 July 2019 / Published: 30 July 2019
Bayesian model evidence (BME) is a measure of the average fit of a model to observation data given all the parameter values that the model can assume. By accounting for the trade-off between goodness-of-fit and model complexity, BME is used for model selection and model averaging purposes. For strict Bayesian computation, the theoretically unbiased Monte Carlo based numerical estimators are preferred over semi-analytical solutions. This study examines five BME numerical estimators and asks how accurate estimation of the BME is important for penalizing model complexity. The limiting cases for numerical BME estimators are the prior sampling arithmetic mean estimator (AM) and the posterior sampling harmonic mean (HM) estimator, which are straightforward to implement, yet they result in underestimation and overestimation, respectively. We also consider the path sampling methods of thermodynamic integration (TI) and steppingstone sampling (SS) that sample multiple intermediate distributions that link the prior and the posterior. Although TI and SS are theoretically unbiased estimators, they could have a bias in practice arising from numerical implementation. For example, sampling errors of some intermediate distributions can introduce bias. We propose a variant of SS, namely the multiple one-steppingstone sampling (MOSS) that is less sensitive to sampling errors. We evaluate these five estimators using a groundwater transport model selection problem. SS and MOSS give the least biased BME estimation at an efficient computational cost. If the estimated BME has a bias that covariates with the true BME, this would not be a problem because we are interested in BME ratios and not their absolute values. On the contrary, the results show that BME estimation bias can be a function of model complexity. Thus, biased BME estimation results in inaccurate penalization of more complex models, which changes the model ranking. This was less observed with SS and MOSS as with the three other methods. View Full-Text
Keywords: groundwater transport; Bayesian; model selection; Bayesian model averaging; modeling; model complexity; Bayesian model evidence; marginal likelihood groundwater transport; Bayesian; model selection; Bayesian model averaging; modeling; model complexity; Bayesian model evidence; marginal likelihood
Show Figures

Figure 1

MDPI and ACS Style

Elshall, A.S.; Ye, M. Making Steppingstones out of Stumbling Blocks: A Bayesian Model Evidence Estimator with Application to Groundwater Transport Model Selection. Water 2019, 11, 1579.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop