Entropy, Volume 10, Issue 4

We construct non-linear information inequalities from Mat´uˇs’ infinite series of linear information inequalities. Each single non-linear inequality is sufficiently strong to prove that the closure of the set of all entropy functions is not polyhedra...

For 2 x 2 x K contingency tables, Tomizawa considered a Shannon entropy type measure to represent the degree of departure from a log-linear model of no three-factor interaction (the NOTFI model). This paper proposes a generalization of Tomizawa's mea...

The concepts of temperature and entropy as applied in equilibrium thermodynamics do not easily generalize to nonequilibrium systems and there are transient systems where thermodynamics cannot apply. However, it is possible that nonequilibrium steady...

The speed-gradient variational principle (SG-principle) for nonstationary far from equilibrium systems is formulated and illustrated by examples. The SG-model of transient (relaxation) dynamics for systems of a finite number of particles based on max...

At the heart of many ICA techniques is a nonparametric estimate of an information measure, usually via nonparametric density estimation, for example, kernel density estimation. While not as popular as kernel density estimators, orthogonal functions c...

Information entropy (H) is a measure of uncertainty at each position within in a sequence of nucleotides.H was used to characterize a set of influenza A segment 7 nucleotide sequences. Nucleotide locations of high entropy were identified near the 5’...

We present a statistical dynamical Kalman filter and compare its performance to deterministic ensemble square root and stochastic ensemble Kalman filters for error covariance modeling with applications to data assimilation. Our studies compare assimi...

We consider the problem of intercepting communications signals between Multiple-Input Multiple-Output (MIMO) communication systems. To correctly detect a transmitted message it is necessary to know the gain matrix that represents the channel between...

Maximum entropy states or statistical mechanical equilibrium solutions have played an important role in the development of a fundamental understanding of turbulence and its role in geophysical flows. In modern general circulation models of the earth’...

The concept of plasma relaxation as a constrained energy minimization is reviewed. Recent work by the authors on generalizing this approach to partially relaxed threedimensional plasma systems in a way consistent with chaos theory is discussed, with...

This paper addresses the identification of hurricanes in low-resolution global climate models (GCM). As hurricanes are not fully resolvable at the coarse resolution of the GCMs (typically 2.5 × 2.5 deg), indirect methods such as analyzing the environ...

We review the recent progress in the investigation of powerfree words, with particular emphasis on binary cubefree and ternary squarefree words. Besides various bounds on the entropy, we provide bounds on letter frequencies and consider their empiric...

It has come to our attention that names of authors have been misspelled in a paper recently published in Entropy [1]. The correct names are: Gustavo Ferri, Felipe Olivares, Flavia Pennini, Angelo Plastino, Angel R. Plastino and Montserrat Casas. We a...

A model represents the way in which information about the world is captured in a form that can be manipulated for application to new situations. However, quantification of `model error' presents formidable challenges. Various inverse problems in carb...

Together with stars and paths, b-ary trees are one of the most studied acyclic graph structures. As any other structure, a b-ary tree can be seen as containing information. The aim of the present research was to assess through informational entropy t...

The general solutions of the radial attractor flow equations for extremal black holes, both for non-BPS with non-vanishing central charge Z and for Z = 0, are obtained for the so-called stu model, the minimal rank-3 N = 2 symmetric supergravity in d...

We give a survey of the basic statistical ideas underlying the definition of entropy in information theory and their connections with the entropy in the theory of dynamical systems and in statistical mechanics.

When a body approaches equilibrium, energy tends to a minimum and entropy tends to a maximum. Often, or usually, the two tendencies favour different configurations of the body. Thus energy is deterministic in the sense that it favours fixed positions...

Extended thermodynamics is based on a set of equations of balance which are supplemented by local and instantaneous constitutive equations so that the field equations are quasi-linear first order differential equations. If the constitutive functions...

Due to quantum fluctuations, spacetime is foamy on small scales. The degree of foaminess is found to be consistent with holography, a principle prefigured in the physics of black hole entropy. It has bearing on the ultimate accuracies of clocks and m...

The universal principle that an open system can be driven to a state far from equilibrium, or organized, by strong negative entropy flow from its surroundings has been validated in numerous fields from physics and chemistry to the life science. In th...

The goal in this paper is to show how many high-frequency electromagnetic metrology areas can be understood and formulated in terms of entropy evolution, production, and fluctuations. This may be important in nanotechnology where an understanding of...

Configurational information is generated when three or more sources of variance interact. The variations not only disturb each other relationally, but by selecting upon each other, they are also positioned in a configuration. A configuration can be s...