http://www.mdpi.com/journal/entropy/special_issues/distance-info-stat-physics/ Dear Colleagues, The notion of distance plays a pivotal role in information sciences and statistical physics. For example, relative entropy helps our understanding of the asymptotic process of systems and serves to identify how distinguishable two distributions are. It is not exaggerated to say that much effort revolves around clarification of information structure pertain to distance measures (entropies). This special issue should provide a forum to present and discuss recent progress on the topics listed in the keywords below. Takuya YamanoGuest Editor {snippet name="submission_info"} http://www.mdpi.com/1099-4300/13/6/1170/ The Gibbs distribution of statistical physics is an exponential family of probability distributions, which has a mathematical basis of duality in the form of the Legendre transformation. Recent studies of complex systems have found lots of distributions obeying the power law rather than the standard Gibbs type distributions. The Tsallis q-entropy is a typical example capturing such phenomena. We treat the q-Gibbs distribution or the q-exponential family by generalizing the exponential function to the q-family of power functions, which is useful for studying various complex or non-standard physical phenomena. We give a new mathematical structure to the q-exponential family different from those previously given. It has a dually flat geometrical structure derived from the Legendre transformation and the conformal geometry is useful for understanding it. The q-version of the maximum entropy theorem is naturally induced from the q-Pythagorean theorem. We also show that the maximizer of the q-escort distribution is a Bayesian MAP (Maximum A posteriori Probability) estimator. http://www.mdpi.com/1099-4300/13/6/1170/ Tue, 14 Jun 2011 00:00:00 CEST Entropy 2011-06-14 13 6 Article 1170 1185 1099-4300 Geometry of q-Exponential Family of Probability Distributions 2011-06-14 doi: 10.3390/e13061170 Shun-ichi Amari Atsumi Ohara http://www.mdpi.com/1099-4300/13/6/1055/ Statistical complexity measures (SCM) are the composition of two ingredients: (i) entropies and (ii) distances in probability-space. In consequence, SCMs provide a simultaneous quantification of the randomness and the correlational structures present in the system under study. We address in this review important topics underlying the SCM structure, viz., (a) a good choice of probability metric space and (b) how to assess the best distance-choice, which in this context is called a “disequilibrium” and is denoted with the letter Q. Q, indeed the crucial SCM ingredient, is cast in terms of an associated distance D. Since out input data consists of time-series, we also discuss the best way of extracting from the time series a probability distribution P. As an illustration, we show just how these issues affect the description of the classical limit of quantum mechanics. http://www.mdpi.com/1099-4300/13/6/1055/ Fri, 03 Jun 2011 00:00:00 CEST Entropy 2011-06-03 13 6 Article 1055 1075 1099-4300 Distances in Probability Space and the Statistical Complexity Setup 2011-06-03 doi: 10.3390/e13061055 Andres M. Kowalski Maria Teresa Martín Angelo Plastino Osvaldo A. Rosso Montserrat Casas http://www.mdpi.com/1099-4300/12/4/818/ Given iid samples drawn from a distribution with known parametric form, we propose the minimization of expected Bregman divergence to form Bayesian estimates of differential entropy and relative entropy, and derive such estimators for the uniform, Gaussian, Wishart, and inverse Wishart distributions. Additionally, formulas are given for a log gamma Bregman divergence and the differential entropy and relative entropy for the Wishart and inverse Wishart. The results, as always with Bayesian estimates, depend on the accuracy of the prior parameters, but example simulations show that the performance can be substantially improved compared to maximum likelihood or state-of-the-art nonparametric estimators. http://www.mdpi.com/1099-4300/12/4/818/ Fri, 09 Apr 2010 00:00:00 CEST Entropy 2010-04-09 12 4 Article 818 843 1099-4300 Parametric Bayesian Estimation of Differential Entropy and Relative Entropy 2010-04-09 doi: 10.3390/e12040818 Gupta Srivastava http://www.mdpi.com/1099-4300/12/2/262/ In statistical physics, Boltzmann-Shannon entropy provides good understanding for the equilibrium states of a number of phenomena. In statistics, the entropy corresponds to the maximum likelihood method, in which Kullback-Leibler divergence connects Boltzmann-Shannon entropy and the expected log-likelihood function. The maximum likelihood estimation has been supported for the optimal performance, which is known to be easily broken down in the presence of a small degree of model uncertainty. To deal with this problem, a new statistical method, closely related to Tsallis entropy, is proposed and shown to be robust for outliers, and we discuss a local learning property associated with the method. http://www.mdpi.com/1099-4300/12/2/262/ Thu, 25 Feb 2010 00:00:00 CET Entropy 2010-02-25 12 2 Article 262 274 1099-4300 Entropy and Divergence Associated with Power Function and the Statistical Application 2010-02-25 doi: 10.3390/e12020262 Shinto Eguchi Shogo Kato http://www.mdpi.com/1099-4300/11/4/748/ Current research is probing transport on ever smaller scales. Modeling of the electromagnetic interaction with nanoparticles or small collections of dipoles and its associated energy transport and nonequilibrium characteristics requires a detailed understanding of transport properties. The goal of this paper is to use a nonequilibrium statistical-mechanical method to obtain exact time-correlation functions, fluctuation-dissipation theorems (FD), heat and charge transport, and associated transport expressions under electromagnetic driving. We extend the time-symmetric Robertson statistical-mechanical theory to study the exact time evolution of relevant variables and entropy rate in the electromagnetic interaction with materials. In this exact statistical-mechanical theory, a generalized canonical density is used to define an entropy in terms of a set of relevant variables and associated Lagrange multipliers. Then the entropy production rate are defined through the relevant variables. The influence of the nonrelevant variables enter the equations through the projection-like operator and thereby influences the entropy. We present applications to the response functions for the electrical and thermal conductivity, specific heat, generalized temperature, Boltzmann’s constant, and noise. The analysis can be performed either classically or quantum-mechanically, and there are only a few modifications in transferring between the approaches. As an application we study the energy, generalized temperature, and charge transport equations that are valid in nonequilibrium and relate it to heat flow and temperature relations in equilibrium states. http://www.mdpi.com/1099-4300/11/4/748/ Tue, 03 Nov 2009 00:00:00 CET Entropy 2009-11-03 11 4 Article 748 765 1099-4300 Transport of Heat and Charge in Electromagnetic Metrology Based on Nonequilibrium Statistical Mechanics 2009-11-03 doi: 10.3390/e11040748 James Baker-Jarvis Jack Surek