Entropy, Volume 3, Issue 3

This paper illustrates the natural role that Hellinger processes can play in solving problems from ¯nance. We propose an extension of the concept of Hellinger process applicable to entropy distance and f-divergence distances, where f is a convex loga...

Basic concepts and results of that part of Information Theory which is often referred to as "Shannon Theory" are discussed with focus mainly on the discrete case. The paper is expository with some new proofs and extensions of results and concepts.

In its modern formulation, the Maximum Entropy Principle was promoted by E.T. Jaynes, starting in the mid-fifties. The principle dictates that one should look for a distribution, consistent with available information, which maximizes the entropy. How...

Energy, entropy and exergy concepts come from thermodynamics and are applicable to all fields of science and engineering. Therefore, this article intends to provide background for better understanding of these concepts and their differences among var...

It is shown that the classical laws of thermodynamics require that mechanical systems must exhibit energy that becomes unavailable to do useful work. In thermodynamics, this type of energy is called entropy. It is further shown that these laws requir...