Next Article in Journal
The Application of Weighted Entropy Theory in Vulnerability Assessment and On-Line Reconfiguration Implementation of Microgrids
Previous Article in Journal
Maximum Entropy Production vs. Kolmogorov-Sinai Entropy in a Constrained ASEP Model
Previous Article in Special Issue
Consistency and Generalization Bounds for Maximum Entropy Density Estimation
Article Menu

Export Article

Open AccessArticle
Entropy 2014, 16(2), 1047-1069;

The Kalman Filter Revisited Using Maximum Relative Entropy

Department of Mathematics, Clarkson University, Potsdam, New York, USA
Department of Control Technologies, Kaunas University of Technology, Lt-51367 Kaunas, Lithuania
Author to whom correspondence should be addressed.
Received: 12 September 2013 / Revised: 5 February 2014 / Accepted: 7 February 2014 / Published: 19 February 2014
(This article belongs to the Special Issue Maximum Entropy and Bayes Theorem)
View Full-Text   |   Download PDF [387 KB, uploaded 24 February 2015]


In 1960, Rudolf E. Kalman created what is known as the Kalman filter, which is a way to estimate unknown variables from noisy measurements. The algorithm follows the logic that if the previous state of the system is known, it could be used as the best guess for the current state. This information is first applied a priori to any measurement by using it in the underlying dynamics of the system. Second, measurements of the unknown variables are taken. These two pieces of information are taken into account to determine the current state of the system. Bayesian inference is specifically designed to accommodate the problem of updating what we think of the world based on partial or uncertain information. In this paper, we present a derivation of the general Bayesian filter, then adapt it for Markov systems. A simple example is shown for pedagogical purposes. We also show that by using the Kalman assumptions or “constraints”, we can arrive at the Kalman filter using the method of maximum (relative) entropy (MrE), which goes beyond Bayesian methods. Finally, we derive a generalized, nonlinear filter using MrE, where the original Kalman Filter is a special case. We further show that the variable relationship can be any function, and thus, approximations, such as the extended Kalman filter, the unscented Kalman filter and other Kalman variants are special cases as well. View Full-Text
Keywords: Kalman filter; extended Kalman; unscented Kalman; Bayes; Bayesian; complexity; relative entropy; dynamical systems Kalman filter; extended Kalman; unscented Kalman; Bayes; Bayesian; complexity; relative entropy; dynamical systems
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Share & Cite This Article

MDPI and ACS Style

Giffin, A.; Urniezius, R. The Kalman Filter Revisited Using Maximum Relative Entropy. Entropy 2014, 16, 1047-1069.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top