Skip to Content

Entropy, Volume 19, Issue 8

2017 August - 54 articles

Cover Story: How much uncertainty do we have about a given issue? And how relevant is it to another? Information theory provides a framework for quantifying these notions, in terms of entropy, mutual information, and the like. However, it can be difficult to apply in practice, because difficult integrals appear in the calculations. I adapt the Nested Sampling algorithm used in Bayesian statistics, so that it can calculate information theoretic quantities, making applied information theory easier. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (54)

  • Article
  • Open Access
43 Citations
5,211 Views
18 Pages

22 August 2017

A group-constrained maximum correntropy criterion (GC-MCC) algorithm is proposed on the basis of the compressive sensing (CS) concept and zero attracting (ZA) techniques and its estimating behavior is verified over sparse multi-path channels. The pro...

  • Article
  • Open Access
10 Citations
6,755 Views
19 Pages

22 August 2017

The traditional slope stability analysis used the Factor of Safety (FS) from the Limit Equilibrium Theory as the determinant. If the FS was greater than 1, it was considered as “safe” and variables or parameters of uncertainty in the analysis model w...

  • Article
  • Open Access
5 Citations
6,460 Views
16 Pages

22 August 2017

Entropy generation is commonly applied to describe the evolution of irreversible processes, such as heat transfer and turbulence. These are both dominating phenomena in fire propagation. In this paper, entropy generation analysis is applied to a gras...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
22 Citations
6,955 Views
13 Pages

21 August 2017

Electroencephalography (EEG) is frequently used in functional neurological assessment of children with neurological and neuropsychiatric disorders. Multiscale entropy (MSE) can reveal complexity in both short and long time scales and is more feasible...

(This article belongs to the Special Issue Entropy and Electroencephalography II)
  • Article
  • Open Access
12 Citations
5,259 Views
19 Pages

21 August 2017

In this contribution, we introduce the concepts of logical entropy and logical mutual information of experiments in the intuitionistic fuzzy case, and study the basic properties of the suggested measures. Subsequently, by means of the suggested notio...

(This article belongs to the Special Issue Entropy and Its Applications across Disciplines)
  • Article
  • Open Access
4 Citations
10,169 Views
33 Pages

Minimum and Maximum Entropy Distributions for Binary Systems with Known Means and Pairwise Correlations

  • Badr F. Albanna,
  • Christopher Hillar,
  • Jascha Sohl-Dickstein and
  • Michael R. DeWeese

21 August 2017

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with these constra...

(This article belongs to the Special Issue Thermodynamics of Information Processing)
  • Article
  • Open Access
10 Citations
6,388 Views
22 Pages

20 August 2017

Modeling of a time-varying dynamical system provides insights into the functions of biological neural networks and contributes to the development of next-generation neural prostheses. In this paper, we have formulated a novel sparse multiwavelet-base...

(This article belongs to the Special Issue Entropy in Signal Analysis)
  • Article
  • Open Access
1 Citations
4,750 Views
12 Pages

Iterative QR-Based SFSIC Detection and Decoder Algorithm for a Reed–Muller Space-Time Turbo System

  • Liang-Fang Ni,
  • Yi Wang,
  • Wei-Xia Li,
  • Pei-Zhen Wang and
  • Jia-Yan Zhang

20 August 2017

An iterative QR-based soft feedback segment interference cancellation (QRSFSIC) detection and decoder algorithm for a Reed–Muller (RM) space-time turbo system is proposed in this paper. It forms the sufficient statistic for the minimum-mean-square er...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
29 Citations
9,124 Views
17 Pages

An Improved System for Utilizing Low-Temperature Waste Heat of Flue Gas from Coal-Fired Power Plants

  • Shengwei Huang,
  • Chengzhou Li,
  • Tianyu Tan,
  • Peng Fu,
  • Gang Xu and
  • Yongping Yang

19 August 2017

In this paper, an improved system to efficiently utilize the low-temperature waste heat from the flue gas of coal-fired power plants is proposed based on heat cascade theory. The essence of the proposed system is that the waste heat of exhausted flue...

(This article belongs to the Special Issue Work Availability and Exergy Analysis)
  • Article
  • Open Access
14 Citations
7,886 Views
33 Pages

19 August 2017

Low-rank matrix factorizations such as Principal Component Analysis (PCA), Singular Value Decomposition (SVD) and Non-negative Matrix Factorization (NMF) are a large class of methods for pursuing the low-rank approximation of a given data matrix. The...

(This article belongs to the Special Issue Information Theory in Machine Learning and Data Science)
  • Article
  • Open Access
8 Citations
5,658 Views
18 Pages

18 August 2017

The relationship between soil water content (SWC) and vegetation, topography, and climatic conditions is critical for developing effective agricultural water management practices and improving agricultural water use efficiency in arid areas. The purp...

(This article belongs to the Special Issue Entropy Applications in Environmental and Water Engineering)
  • Article
  • Open Access
102 Citations
9,375 Views
12 Pages

18 August 2017

This communication addresses a comparison of newly presented non-integer order derivatives with and without singular kernel, namely Michele Caputo–Mauro Fabrizio (CF) C F ( ∂ β / ∂ t β ) and Atangana–Baleanu (AB) ...

(This article belongs to the Special Issue Non-Equilibrium Thermodynamics of Micro Technologies)
  • Article
  • Open Access
23 Citations
6,699 Views
20 Pages

18 August 2017

The periodical transient impulses caused by localized faults are sensitive and important characteristic information for rotating machinery fault diagnosis. However, it is very difficult to accurately extract transient impulses at the incipient fault...

  • Article
  • Open Access
9 Citations
7,091 Views
18 Pages

18 August 2017

The Shannon entropy, and related quantities such as mutual information, can be used to quantify uncertainty and relevance. However, in practice, it can be difficult to compute these quantities for arbitrary probability distributions, particularly if...

(This article belongs to the Special Issue Maximum Entropy and Bayesian Methods)
  • Review
  • Open Access
89 Citations
14,807 Views
16 Pages

18 August 2017

The security of the Internet of Things (IoT) is receiving considerable interest as the low power constraints and complexity features of many IoT devices are limiting the use of conventional cryptographic techniques. This article provides an overview...

(This article belongs to the Special Issue Information-Theoretic Security)
  • Article
  • Open Access
8 Citations
7,123 Views
16 Pages

Deformed Jarzynski Equality

  • Jiawen Deng,
  • Juan D. Jaramillo,
  • Peter Hänggi and
  • Jiangbin Gong

18 August 2017

The well-known Jarzynski equality, often written in the form e − β Δ F = 〈 e − β W 〉 , provides a non-equilibrium means to measure the free energy difference Δ F of a system at the same inverse temperature β based on an...

(This article belongs to the Special Issue Quantum Thermodynamics)
  • Article
  • Open Access
5 Citations
8,360 Views
13 Pages

Power-Law Distributions from Sigma-Pi Structure of Sums of Random Multiplicative Processes

  • Arthur Matsuo Yamashita Rios de Sousa,
  • Hideki Takayasu,
  • Didier Sornette and
  • Misako Takayasu

17 August 2017

We introduce a simple growth model in which the sizes of entities evolve as multiplicative random processes that start at different times. A novel aspect we examine is the dependence among entities. For this, we consider three classes of dependence b...

(This article belongs to the Special Issue Statistical Mechanics of Complex and Disordered Systems)
  • Article
  • Open Access
40 Citations
8,178 Views
24 Pages

Thermal and Exergetic Analysis of the Goswami Cycle Integrated with Mid-Grade Heat Sources

  • Gokmen Demirkaya,
  • Ricardo Vasquez Padilla,
  • Armando Fontalvo,
  • Maree Lake and
  • Yee Yan Lim

17 August 2017

This paper presents a theoretical investigation of a combined Power and Cooling Cycle that employs an Ammonia-Water mixture. The cycle combines a Rankine and an absorption refrigeration cycle. The Goswami cycle can be used in a wide range of applicat...

(This article belongs to the Special Issue Work Availability and Exergy Analysis)
  • Discussion
  • Open Access
5 Citations
9,578 Views
20 Pages

17 August 2017

In the present paper, a Quality Systems Theory is presented. Certifiable Quality Systems are treated and interpreted in accordance with a Thermodynamics-based approach. Analysis is also conducted on the relationship between Quality Management Systems...

(This article belongs to the Special Issue Entropy and Its Applications across Disciplines)
  • Article
  • Open Access
8 Citations
5,514 Views
15 Pages

The Emergence of Hyperchaos and Synchronization in Networks with Discrete Periodic Oscillators

  • Adrian Arellano-Delgado,
  • Rosa Martha López-Gutiérrez,
  • Miguel Angel Murillo-Escobar,
  • Liliana Cardoza-Avendaño and
  • César Cruz-Hernández

16 August 2017

In this paper, the emergence of hyperchaos in a network with two very simple discrete periodic oscillators is presented. Uncoupled periodic oscillators may represent, in the crudest and simplest form, periodic oscillators in nature, for example firef...

(This article belongs to the Special Issue Complex Systems, Non-Equilibrium Dynamics and Self-Organisation)
  • Article
  • Open Access
25 Citations
7,682 Views
14 Pages

13 August 2017

We study the q-voter model driven by stochastic noise arising from one out of two types of nonconformity: anticonformity or independence. We compare two approaches that were inspired by the famous psychological controversy known as the person–situati...

(This article belongs to the Special Issue Statistical Mechanics of Complex and Disordered Systems)
  • Article
  • Open Access
21 Citations
5,407 Views
15 Pages

11 August 2017

This article describes the impact of slip conditions on nanofluid flow through a stretching sheet. Nanofluids are very helpful to enhance the convective heat transfer in a boundary layer flow. Prandtl number also play a major role in controlling the...

(This article belongs to the Special Issue Entropy Generation in Nanofluid Flows)
  • Article
  • Open Access
28 Citations
8,291 Views
17 Pages

10 August 2017

This paper analyses the relations between entropy, organizational capabilities and corporate entrepreneurship. The results indicate strong links between strategy and corporate entrepreneurship, moderated by the organizational capabilities. We find th...

(This article belongs to the Special Issue Statistical Mechanics of Complex and Disordered Systems)
  • Article
  • Open Access
13 Citations
9,209 Views
9 Pages

10 August 2017

The entropy of the observable universe is increasing. Thus, at earlier times the entropy was lower. However, the cosmic microwave background radiation reveals an apparently high entropy universe close to thermal and chemical equilibrium. A two-part s...

(This article belongs to the Special Issue Entropy, Time and Evolution)
  • Feature Paper
  • Review
  • Open Access
14 Citations
7,295 Views
51 Pages

A View of Information-Estimation Relations in Gaussian Networks

  • Alex Dytso,
  • Ronit Bustin,
  • H. Vincent Poor and
  • Shlomo Shamai (Shitz)

9 August 2017

Relations between estimation and information measures have received considerable attention from the information theory community. One of the most notable such relationships is the I-MMSE identity of Guo, Shamai and Verdú that connects the mutual info...

(This article belongs to the Special Issue Network Information Theory)
  • Feature Paper
  • Article
  • Open Access
87 Citations
12,709 Views
18 Pages

8 August 2017

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituti...

(This article belongs to the Special Issue Information Decomposition of Target Effects from Multi-Source Interactions)
  • Article
  • Open Access
27 Citations
6,939 Views
12 Pages

7 August 2017

In this contribution, we develop the Maxwell generalized thermodynamical relations via the metric derivative model upon the mapping to a continuous fractal space. This study also introduces the total q-derivative expressions depending on two variable...

(This article belongs to the Special Issue Phenomenological Thermodynamics of Irreversible Processes)
  • Article
  • Open Access
1 Citations
7,269 Views
12 Pages

7 August 2017

In statistical process control, the control chart utilizing the idea of maximum entropy distribution density level sets has been proven to perform well for monitoring the quantity with multimodal distribution. However, it is too complicated to implem...

(This article belongs to the Special Issue Maximum Entropy and Bayesian Methods)
  • Article
  • Open Access
9 Citations
5,527 Views
16 Pages

6 August 2017

One main interest of information geometry is to study the properties of statistical models that do not depend on the coordinate systems or model parametrization; thus, it may serve as an analytic tool for intrinsic inference in statistics. In this pa...

(This article belongs to the Special Issue Information Geometry II)
  • Article
  • Open Access
21 Citations
6,414 Views
16 Pages

5 August 2017

In the present paper, thermal transport and entropy production mechanisms in a turbulent round jet of compressed nitrogen at supercritical thermodynamic conditions are investigated using a direct numerical simulation. First, thermal transport and its...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
18 Citations
3,883 Views
9 Pages

Optimal Belief Approximation

  • Reimar H. Leike and
  • Torsten A. Enßlin

4 August 2017

In Bayesian statistics probability distributions express beliefs. However, for many problems the beliefs cannot be computed analytically and approximations of beliefs are needed. We seek a loss function that quantifies how “embarrassing” it is to com...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
13 Citations
5,923 Views
18 Pages

On the Modelling and Control of a Laboratory Prototype of a Hydraulic Canal Based on a TITO Fractional-Order Model

  • Andres San-Millan,
  • Daniel Feliu-Talegón,
  • Vicente Feliu-Batlle and
  • Raul Rivas-Perez

3 August 2017

In this paper a two-input, two-output (TITO) fractional order mathematical model of a laboratory prototype of a hydraulic canal is proposed. This canal is made up of two pools that have a strong interaction between them. The inputs of the TITO model...

(This article belongs to the Special Issue Complex Systems and Fractional Dynamics)
  • Article
  • Open Access
25 Citations
3,917 Views
8 Pages

2 August 2017

Over the last decade, it has been found that nonlinear laws of composition of momenta are predicted by some alternative approaches to “real” 4D quantum gravity, and by all formulations of dimensionally-reduced (3D) quantum gravity coupled to matter....

(This article belongs to the Special Issue Quantum Information and Foundations)
  • Article
  • Open Access
5 Citations
4,023 Views
19 Pages

Coupled DM Heating in SCDEW Cosmologies

  • Silvio Bonometto and
  • Roberto Mainini

2 August 2017

Strongly-Coupled Dark Energy plus Warm dark matter (SCDEW) cosmologies admit the stationary presence of ∼1% of coupled-DM and DE, since inflationary reheating. Coupled-DM fluctuations therefore grow up to non-linearity even in the early radiative exp...

(This article belongs to the Section Astrophysics, Cosmology, and Black Holes)
  • Article
  • Open Access
31 Citations
6,862 Views
16 Pages

2 August 2017

Networks of stochastic spiking neurons are interesting models in the area of theoretical neuroscience, presenting both continuous and discontinuous phase transitions. Here, we study fully-connected networks analytically, numerically and by computatio...

(This article belongs to the Special Issue Complex Systems, Non-Equilibrium Dynamics and Self-Organisation)
  • Article
  • Open Access
15 Citations
5,631 Views
16 Pages

2 August 2017

This paper presents a novel low probability of intercept (LPI) optimization framework in radar network by minimizing the Schleher intercept factor based on minimum mean-square error (MMSE) estimation. MMSE of the estimate of the target scatterer matr...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
5 Citations
4,248 Views
12 Pages

1 August 2017

In this paper, a new method for controlling a quantum ensemble that its members have uncertainties in Hamiltonian parameters is designed. Based on combining the sampling-based learning control (SLC) and a new quantum genetic algorithm (QGA) method, t...

(This article belongs to the Special Issue Quantum Information and Foundations)
  • Article
  • Open Access
146 Citations
11,909 Views
16 Pages

A Fuzzy Comprehensive Evaluation Method Based on AHP and Entropy for a Landslide Susceptibility Map

  • Hongliang Zhao,
  • Leihua Yao,
  • Gang Mei,
  • Tianyu Liu and
  • Yuansong Ning

1 August 2017

Landslides are a common type of natural disaster in mountainous areas. As a result of the comprehensive influences of geology, geomorphology and climatic conditions, the susceptibility to landslide hazards in mountainous areas shows obvious regionali...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
18 Citations
8,672 Views
23 Pages

1 August 2017

We present a systematic coarse-graining (CG) strategy for many particle molecular systems based on cluster expansion techniques. We construct a hierarchy of coarse-grained Hamiltonians with interaction potentials consisting of two, three and higher b...

(This article belongs to the Special Issue Thermodynamics and Statistical Mechanics of Small Systems)
  • Article
  • Open Access
3 Citations
6,936 Views
8 Pages

31 July 2017

Analysis of global energy efficiency of thermal systems is of practical importance for a number of reasons. Cycles and processes used in thermal systems exist in very different configurations, making comparison difficult if specific models are requir...

(This article belongs to the Special Issue Carnot Cycle and Heat Engine Fundamentals and Applications)
  • Article
  • Open Access
6 Citations
4,110 Views
12 Pages

29 July 2017

In a given problem, the Bayesian statistical paradigm requires the specification of a prior distribution that quantifies relevant information about the unknowns of main interest external to the data. In cases where little such information is availabl...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
4 Citations
5,703 Views
14 Pages

29 July 2017

We introduce a distributed protocol to achieve multiuser diversity in a multicell multiple-input multiple-output (MIMO) uplink network, referred to as a MIMO interfering multiple-access channel (IMAC). Assuming both no information exchange among base...

(This article belongs to the Special Issue Network Information Theory)
  • Feature Paper
  • Article
  • Open Access
11 Citations
6,246 Views
22 Pages

A Thermodynamic Point of View on Dark Energy Models

  • Vincenzo F. Cardone,
  • Ninfa Radicella and
  • Antonio Troisi

29 July 2017

We present a conjugate analysis of two different dark energy models, namely the Barboza–Alcaniz parameterization and the phenomenologically-motivated Hobbit model, investigating both their agreement with observational data and their thermodynamical p...

(This article belongs to the Section Astrophysics, Cosmology, and Black Holes)
  • Article
  • Open Access
10 Citations
8,215 Views
18 Pages

29 July 2017

Geophysical time series have a complex nature that poses challenges to reaching assertive conclusions, and require advanced mathematical and computational tools to unravel embedded information. In this paper, time–frequency methods and hierarchical c...

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory III)
  • Article
  • Open Access
19 Citations
4,570 Views
30 Pages

On the Reliability Function of Variable-Rate Slepian-Wolf Coding

  • Jun Chen,
  • Da-ke He,
  • Ashish Jagmohan and
  • Luis A. Lastras-Montaño

28 July 2017

The reliability function of variable-rate Slepian-Wolf coding is linked to the reliability function of channel coding with constant composition codes, through which computable lower and upper bounds are derived. The bounds coincide at rates close to...

(This article belongs to the Special Issue Multiuser Information Theory)
  • Article
  • Open Access
6 Citations
3,536 Views
10 Pages

28 July 2017

This study considers the goodness of fit test for a class of conditionally heteroscedastic location-scale time series models. For this task, we develop an entropy-type goodness of fit test based on residuals. To examine the asymptotic behavior of the...

  • Article
  • Open Access
35 Citations
7,833 Views
29 Pages

27 July 2017

Driver fatigue is an important factor in traffic accidents, and the development of a detection system for driver fatigue is of great significance. To estimate and prevent driver fatigue, various classifiers based on electroencephalogram (EEG) signals...

(This article belongs to the Special Issue Entropy and Electroencephalography II)
  • Article
  • Open Access
8 Citations
5,600 Views
11 Pages

On Increased Arc Endurance of the Cu–Cr System Materials

  • Iosif S. Gershman,
  • Eugeniy I. Gershman,
  • Alexander E. Mironov,
  • German S. Fox-Rabinovich and
  • Stephen C. Veldhuis

27 July 2017

The study deals with arc resistance of composite Cu–Cr system materials of various compositions. The microstructure of materials exposed to an electric arc was investigated. Despite varying initial chromium contents, the same structure was formed in...

(This article belongs to the Special Issue Thermodynamics in Material Science)
  • Article
  • Open Access
10 Citations
5,137 Views
11 Pages

27 July 2017

The origin of the long-range memory in non-equilibrium systems is still an open problem as the phenomenon can be reproduced using models based on Markov processes. In these cases, the notion of spurious memory is introduced. A good example of Markov...

(This article belongs to the Special Issue Statistical Mechanics of Complex and Disordered Systems)

of 2

XFacebookLinkedIn
Entropy - ISSN 1099-4300