Entropy2014, 16(12), 6722-6738; doi:10.3390/e16126722 - published 22 December 2014 Show/Hide Abstract
Abstract: We prove a large deviation principle for a stationary Gaussian process over Rb,indexed by Ζd (for some positive integers d and b), with positive definite spectral density, andprovide an expression of the corresponding rate function in terms of the mean of the processand its spectral density. This result is useful in applications where such an expression isneeded.
Entropy2014, 16(12), 6705-6721; doi:10.3390/e16126705 - published 22 December 2014 Show/Hide Abstract
Abstract: In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback–Leibler Divergence) R(μ||P), where μ and P are measures on C([0,T];Rd). The underlying measure P is a weak solution to a martingale problem with continuous coefficients. Our representation is in the form of an integral with respect to its infinitesimal generator. This representation is of use in statistical inference (particularly involving medical imaging). Since R(μ||P) governs the exponential rate of convergence of the empirical measure (according to Sanov’s theorem), this representation is also of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions.
Entropy2014, 16(12), 6686-6704; doi:10.3390/e16126686 - published 22 December 2014 Show/Hide Abstract
Abstract: Short-term complexity of heart period (HP) and systolic arterial pressure (SAP) was computed to detect age and gender influences over cardiovascular control in resting supine condition (REST) and during standing (STAND). Healthy subjects (n = 110, men = 55) were equally divided into five groups (21–30; 31–40; 41–50; 51–60; and 61–70 years of age). HP and SAP series were recorded for 15 min at REST and during STAND. A normalized complexity index (NCI) based on conditional entropy was assessed. At REST we found that both NCIHP and NCISAP decreased with age in the overall population, but only women were responsible for this trend. During STAND we observed that both NCIHP and NCISAP were unrelated to age in the overall population, even when divided by gender. When the variation of NCI in response to STAND (ΔNCI = NCI at REST-NCI during STAND) was computed individually, we found that ΔNCIHP progressively decreased with age in the overall population, and women were again responsible for this trend. Conversely, ΔNCISAP was unrelated to age and gender. This study stresses that the complexity of cardiovascular control and its ability to respond to stressors are more importantly lost with age in women than in men.
Entropy2014, 16(12), 6667-6685; doi:10.3390/e16126667 - published 19 December 2014 Show/Hide Abstract
Abstract: The latter-day H.265/HEVC video compression standard is able to provide two-times higher compression efficiency compared to the current industrial standard, H.264/AVC. However, coding complexity also increased. The main bottleneck of the compression process is the rate-distortion optimization (RDO) stage, as it involves numerous sequential syntax-based binary arithmetic coding (SBAC) loops. In this paper, we present an entropy-based RDO estimation technique for H.265/HEVC compression, instead of the common approach based on the SBAC. Our RDO implementation reduces RDO complexity, providing an average bit rate overhead of 1.54%. At the same time, elimination of the SBAC from the RDO estimation reduces block interdependencies, thus providing an opportunity for the development of the compression system with parallel processing of multiple blocks of a video frame.
Entropy2014, 16(12), 6654-6666; doi:10.3390/e16126654 - published 19 December 2014 Show/Hide Abstract
Abstract: This paper presents the effects of spontaneous random activity on information transmission in an auditory brain stem neuron model. In computer simulations, the supra-threshold synaptic current stimuli ascending from auditory nerve fibers (ANFs) were modeled by a filtered inhomogeneous Poisson process modulated by sinusoidal functions at a frequency of 220–3520 Hz with regard to the human speech spectrum. The stochastic sodium and stochastic high- and low-threshold potassium channels were incorporated into a single compartment model of the soma in spherical bushy neurons, so as to realize threshold fluctuations or a variation of spike firing times. The results show that the information rates estimated from the entropy of inter-spike intervals of spike trains tend toward a convex function of the spontaneous rates when the intensity of sinusoidal functions decreases. Furthermore, the results show that a convex function of the spontaneous rates tends to disappear as the frequency of the sinusoidal function increases, such that the phase-locked response can be unobserved. It is concluded that this sort of stochastic resonance (SR) phenomenon, which depends on the spontaneous rates with supra-threshold stimuli, can better enhance information transmission in a smaller intensity of sinusoidal functions within the human speech spectrum, like the situation in which the regular SR can enhance weak signals.
Entropy2014, 16(12), 6624-6653; doi:10.3390/e16126624 - published 19 December 2014 Show/Hide Abstract
Abstract: For the simplest colored branching process, we prove an analog to the McMillan theorem and calculate the Hausdorff dimensions of random fractals defined in terms of the limit behavior of empirical measures generated by finite genetic lines. In this setting, the role of Shannon’s entropy is played by the Kullback–Leibler divergence, and the Hausdorff dimensions are computed by means of the so-called Billingsley–Kullback entropy, defined in the paper.