Entropy, Volume 13, Issue 4

Landauer’s principle and the Holographic principle are used to derive the holographic information energy contribution to the Universe. Information energy density has increased with star formation until sufficient to start accelerating the expansion o...

Feature selection is an important step in building accurate classifiers and provides better understanding of the data sets. In this paper, we propose a feature subset selection method based on high-dimensional mutual information. We also propose to u...

Information content and compression are tightly related concepts that can be addressed through both classical and algorithmic information theories, on the basis of Shannon entropy and Kolmogorov complexity, respectively. The definition of several ent...

Nadykto, Yu, Jakovleva, Herb and Xu have recently reported a DFT study on the structure and formation thermodynamics of sulfuric acid-base-water clusters, with ammonia and a handful of amines as bases [1]. This study partially overlaps with our previ...

This paper proposes a global multi-level thresholding method for image segmentation. As a criterion for this, the traditional method uses the Shannon entropy, originated from information theory, considering the gray level image histogram as a probabi...

The classical information-theoretic measures such as the entropy and the mutual information (MI) are widely applicable to many areas in science and engineering. Csiszar generalized the entropy and the MI by using the convex functions. Recently, we pr...

The gravity and magnetic data measured on the Earth’s surface or above it (collected from an aircraft flying at low altitude) can be used to assist in geologic mapping by estimating the spatial density and magnetization distributions, respectively, p...

In the present paper, we propose a large sample asymptotic approximation for the sampling and posterior distributions of differential entropy when the sample is composed of independent and identically distributed realization of a multivariate normal...

In this paper, a representation of the information-disturbance theorem based on the quantum Kolmogorov complexity that was defined by P. Vit´anyi has been examined. In the quantum information theory, the information-disturbance relationship, which tr...

We study the classical field theoretical formulation of static generic isolated horizons in a manifestly SU(2) invariant formulation. We show that the usual classical description requires revision in the non-static case due to the breaking of diffeom...