Next Article in Journal
Ab Initio and Monte Carlo Approaches For the Magnetocaloric Effect in Co- and In-Doped Ni-Mn-Ga Heusler Alloys
Next Article in Special Issue
Editorial Comment on the Special Issue of “Information in Dynamical Systems and Complex Systems”
Previous Article in Journal
The Character of Entropy Production in Rayleigh–Bénard Convection
Previous Article in Special Issue
Information Anatomy of Stochastic Equilibria
Article Menu

Export Article

Open AccessArticle
Entropy 2014, 16(9), 4974-4991; doi:10.3390/e16094974

Simultaneous State and Parameter Estimation Using Maximum Relative Entropy with Nonhomogenous Differential Equation Constraints

1
Department of Mathematics, Clarkson University, Potsdam, NY 13699, USA
2
Department of Automation, Kaunas University of Technology, Kaunas Lt-51367, Lithuania
*
Author to whom correspondence should be addressed.
Received: 23 April 2014 / Revised: 26 June 2014 / Accepted: 12 September 2014 / Published: 17 September 2014
(This article belongs to the Special Issue Information in Dynamical Systems and Complex Systems)
View Full-Text   |   Download PDF [352 KB, uploaded 24 February 2015]   |  

Abstract

In this paper, we continue our efforts to show how maximum relative entropy (MrE) can be used as a universal updating algorithm. Here, our purpose is to tackle a joint state and parameter estimation problem where our system is nonlinear and in a non-equilibrium state, i.e., perturbed by varying external forces. Traditional parameter estimation can be performed by using filters, such as the extended Kalman filter (EKF). However, as shown with a toy example of a system with first order non-homogeneous ordinary differential equations, assumptions made by the EKF algorithm (such as the Markov assumption) may not be valid. The problem can be solved with exponential smoothing, e.g., exponentially weighted moving average (EWMA). Although this has been shown to produce acceptable filtering results in real exponential systems, it still cannot simultaneously estimate both the state and its parameters and has its own assumptions that are not always valid, for example when jump discontinuities exist. We show that by applying MrE as a filter, we can not only develop the closed form solutions, but we can also infer the parameters of the differential equation simultaneously with the means. This is useful in real, physical systems, where we want to not only filter the noise from our measurements, but we also want to simultaneously infer the parameters of the dynamics of a nonlinear and non-equilibrium system. Although there were many assumptions made throughout the paper to illustrate that EKF and exponential smoothing are special cases ofMrE, we are not “constrained”, by these assumptions. In other words, MrE is completely general and can be used in broader ways. View Full-Text
Keywords: Kalman filter; extended Kalman; Bayesian; complexity; nonhomogenous differential equation; nonlinear; non-equilibrium; relative entropy; dynamical systems Kalman filter; extended Kalman; Bayesian; complexity; nonhomogenous differential equation; nonlinear; non-equilibrium; relative entropy; dynamical systems
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Giffin, A.; Urniezius, R. Simultaneous State and Parameter Estimation Using Maximum Relative Entropy with Nonhomogenous Differential Equation Constraints. Entropy 2014, 16, 4974-4991.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top