Skip to Content

Entropy, Volume 19, Issue 5

2017 May - 54 articles

Cover Story: Any system can be described at a multitude of spatial and temporal scales. One long-standing reductionist assumption is that the lowest possible microscale should contain the maximum information about the causal structure of any system. While some have argued that higher-level macroscales might be useful because of computational constraints, it has been widely accepted that they are like maps; i.e., at best macroscales are lossless compressions of the underlying territory. Assessing causal structures using the information theory leads to a different conclusion: macroscales can act like error-correcting codes for causal relationships. From this error-correcting ability, macroscales can have more causal influence and contain greater information than their underlying microscales. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (54)

  • Article
  • Open Access
8 Citations
5,962 Views
15 Pages

Entropy in Investigation of Vasovagal Syndrome in Passive Head Up Tilt Test

  • Katarzyna Buszko,
  • Agnieszka Piątkowska,
  • Edward Koźluk and
  • Grzegorz Opolski

20 May 2017

This paper presents an application of Approximate Entropy (ApEn) and Sample Entropy (SampEn) in the analysis of heart rhythm, blood pressure and stroke volume for the diagnosis of vasovagal syndrome. The analyzed biosignals were recorded during posit...

(This article belongs to the Special Issue Entropy and Cardiac Physics II)
  • Article
  • Open Access
19 Citations
13,402 Views
21 Pages

Can a Robot Have Free Will?

  • Keith Douglas Farnsworth

20 May 2017

Using insights from cybernetics and an information-based understanding of biological systems, a precise, scientifically inspired, definition of free-will is offered and the essential requirements for an agent to possess it in principle are set out. T...

(This article belongs to the Special Issue Complexity, Criticality and Computation (C³))
  • Article
  • Open Access
4 Citations
5,860 Views
14 Pages

20 May 2017

An open question in nonlinear dynamics is the relation between the Kolmogorov entropy and the largest Lyapunov exponent of a given orbit. Both have been shown to have diagnostic capability for phase transitions in thermodynamic systems. For systems w...

(This article belongs to the Special Issue Thermodynamics and Statistical Mechanics of Small Systems)
  • Feature Paper
  • Article
  • Open Access
3 Citations
6,149 Views
35 Pages

20 May 2017

This paper presents a coding theorem for linear coding over finite rings, in the setting of the Slepian–Wolf source coding problem. This theorem covers corresponding achievability theorems of Elias (IRE Conv. Rec. 1955, 3, 37–46) and Csiszár (IEEE Tr...

(This article belongs to the Special Issue Network Information Theory)
  • Article
  • Open Access
24 Citations
7,435 Views
14 Pages

19 May 2017

Entropy methods enable a convenient general approach to providing a probability distribution with partial information. The minimum cross-entropy principle selects the distribution that minimizes the Kullback–Leibler divergence subject to the given co...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
5 Citations
5,481 Views
14 Pages

19 May 2017

In classical Maxwell electrodynamics, charged particles following deterministic trajectories are described by currents that induce fields, mediating interactions with other particles. Statistical methods are used when needed to treat complex particle...

(This article belongs to the Section Statistical Physics)
  • Article
  • Open Access
11 Citations
9,330 Views
11 Pages

18 May 2017

Li2O belongs to the family of antifluorites that show superionic behavior at high temperatures. While some of the superionic characteristics of Li2O are well-known, the mechanistic details of ionic conduction processes are somewhat nebulous. In this...

(This article belongs to the Special Issue Understanding Molecular Dynamics via Stochastic Processes)
  • Article
  • Open Access
3 Citations
8,541 Views
46 Pages

18 May 2017

We present a first formal analysis of specific and complete local integration. Complete local integration was previously proposed as a criterion for detecting entities or wholes in distributed dynamical systems. Such entities in turn were conceived t...

(This article belongs to the Special Issue Complexity, Criticality and Computation (C³))
  • Article
  • Open Access
26 Citations
5,694 Views
15 Pages

18 May 2017

According to non-stationary characteristic of the acoustic emission signal of rolling element bearings, a novel fault diagnosis method based on empirical wavelet transform (EWT) and ambiguity correlation classification (ACC) is proposed. In the propo...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
25 Citations
9,592 Views
15 Pages

17 May 2017

To investigate the intra- and inter-limb muscle coordination mechanism of human hands-and-knees crawling by means of muscle synergy analysis, surface electromyographic (sEMG) signals of 20 human adults were collected bilaterally from 32 limb related...

(This article belongs to the Special Issue Information Theory Applied to Physiological Signals)
  • Article
  • Open Access
11 Citations
6,724 Views
15 Pages

Face Verification with Multi-Task and Multi-Scale Feature Fusion

  • Xiaojun Lu,
  • Yue Yang,
  • Weilin Zhang,
  • Qi Wang and
  • Yang Wang

17 May 2017

Face verification for unrestricted faces in the wild is a challenging task. This paper proposes a method based on two deep convolutional neural networks (CNN) for face verification. In this work, we explore using identification signals to supervise o...

(This article belongs to the Special Issue Information Theory in Machine Learning and Data Science)
  • Article
  • Open Access
41 Citations
11,079 Views
19 Pages

Information Entropy and Measures of Market Risk

  • Daniel Traian Pele,
  • Emese Lazar and
  • Alfonso Dufour

16 May 2017

In this paper we investigate the relationship between the information entropy of the distribution of intraday returns and intraday and daily measures of market risk. Using data on the EUR/JPY exchange rate, we find a negative relationship between ent...

  • Article
  • Open Access
4 Citations
5,677 Views
15 Pages

Classification of Fractal Signals Using Two-Parameter Non-Extensive Wavelet Entropy

  • Julio César Ramírez-Pacheco,
  • Joel Antonio Trejo-Sánchez,
  • Joaquin Cortez-González and
  • Ramón R. Palacio

15 May 2017

This article proposes a methodology for the classification of fractal signals as stationary or nonstationary. The methodology is based on the theoretical behavior of two-parameter wavelet entropy of fractal signals. The wavelet ( q , q ) -...

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory II)
  • Article
  • Open Access
30 Citations
6,101 Views
10 Pages

Entropy Information of Cardiorespiratory Dynamics in Neonates during Sleep

  • Maristella Lucchini,
  • Nicolò Pini,
  • William P. Fifer,
  • Nina Burtchen and
  • Maria G. Signorini

15 May 2017

Sleep is a central activity in human adults and characterizes most of the newborn infant life. During sleep, autonomic control acts to modulate heart rate variability (HRV) and respiration. Mechanisms underlying cardiorespiratory interactions in diff...

(This article belongs to the Special Issue Entropy and Sleep Disorders)
  • Article
  • Open Access
1 Citations
4,668 Views
23 Pages

13 May 2017

The change of zero order entropy is studied over different strategies of grammar production rule selection. The two major rules are distinguished: transformations leaving the message size intact and substitution functions changing the message size. R...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
50 Citations
8,371 Views
17 Pages

Calculating Iso-Committor Surfaces as Optimal Reaction Coordinates with Milestoning

  • Ron Elber,
  • Juan M. Bello-Rivas,
  • Piao Ma,
  • Alfredo E. Cardenas and
  • Arman Fathizadeh

11 May 2017

Reaction coordinates are vital tools for qualitative and quantitative analysis of molecular processes. They provide a simple picture of reaction progress and essential input for calculations of free energies and rates. Iso-committor surfaces are cons...

(This article belongs to the Special Issue Understanding Molecular Dynamics via Stochastic Processes)
  • Article
  • Open Access
5,108 Views
20 Pages

A Functorial Construction of Quantum Subtheories

  • Ivan Contreras and
  • Ali Nabi Duman

11 May 2017

We apply the geometric quantization procedure via symplectic groupoids to the setting of epistemically-restricted toy theories formalized by Spekkens (Spekkens, 2016). In the continuous degrees of freedom, this produces the algebraic structure of qua...

(This article belongs to the Special Issue Quantum Mechanics: From Foundations to Information Technologies)
  • Article
  • Open Access
12 Citations
9,447 Views
15 Pages

11 May 2017

This study aimed to investigate the fatiguing characteristics of muscle-tendon units (MTUs) within skeletal muscles during static isometric contraction tasks. The deltoid was selected as the target muscle and three head-related static isometric contr...

(This article belongs to the Special Issue Information Theory Applied to Physiological Signals)
  • Article
  • Open Access
17 Citations
4,713 Views
15 Pages

11 May 2017

Stochastic distribution control (SDC) systems are a group of systems where the outputs considered is the measured probability density function (PDF) of the system output whilst subjected to a normal crisp input. The purpose of the active fault tolera...

  • Article
  • Open Access
6 Citations
5,692 Views
16 Pages

10 May 2017

In this paper, we apply the differential Galoisian approach to investigate the meromorphic non-integrability of a class of 3D equations in mathematical physics, including Nosé–Hoover equations, the Lü system, the Rikitake-like system and Rucklidge eq...

(This article belongs to the Special Issue Complex Systems, Non-Equilibrium Dynamics and Self-Organisation)
  • Article
  • Open Access
12 Citations
16,362 Views
9 Pages

Cauchy Principal Value Contour Integral with Applications

  • Matilde Legua and
  • Luis M. Sánchez-Ruiz

10 May 2017

Cauchy principal value is a standard method applied in mathematical applications by which an improper, and possibly divergent, integral is measured in a balanced way around singularities or at infinity. On the other hand, entropy prediction of system...

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory III)
  • Article
  • Open Access
2 Citations
6,027 Views
23 Pages

9 May 2017

Representing patterns as labeled graphs is becoming increasingly common in the broad field of computational intelligence. Accordingly, a wide repertoire of pattern recognition tools, such as classifiers and knowledge discovery procedures, are nowaday...

(This article belongs to the Special Issue Entropy in Signal Analysis)
  • Article
  • Open Access
15 Citations
7,483 Views
16 Pages

Anatomy of a Spin: The Information-Theoretic Structure of Classical Spin Systems

  • Vikram S. Vijayaraghavan,
  • Ryan G. James and
  • James P. Crutchfield

8 May 2017

Collective organization in matter plays a significant role in its expressed physical properties. Typically, it is detected via an order parameter, appropriately defined for each given system’s observed emergent patterns. Recent developments in inform...

(This article belongs to the Section Statistical Physics)
  • Article
  • Open Access
6 Citations
5,595 Views
12 Pages

Boltzmann Entropy of a Newtonian Universe

  • D. Cabrera,
  • Pedro Fernández de Córdoba and
  • J.M. Isidro

6 May 2017

A dynamical estimate is given for the Boltzmann entropy of the Universe, under the simplifying assumptions provided by Newtonian cosmology. We first model the cosmological fluid as the probability fluid of a quantum-mechanical system. Next, following...

(This article belongs to the Section Astrophysics, Cosmology, and Black Holes)
  • Article
  • Open Access
7 Citations
6,191 Views
18 Pages

6 May 2017

This paper presents a low probability of interception (LPI) radar waveform design method with a fixed average power constraint based on information theory. The Kullback–Leibler divergence (KLD) between the intercept signal and background noise is pre...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
17 Citations
9,187 Views
15 Pages

6 May 2017

In transport planning, one should allow passengers to travel through the complicated transportation scheme with efficient use of different modes of transport. In this paper, we propose the use of a cockroach swarm optimization algorithm for determini...

(This article belongs to the Special Issue Complexity, Criticality and Computation (C³))
  • Article
  • Open Access
7 Citations
6,022 Views
11 Pages

4 May 2017

Asymptotic behavior of qualitative variation statistics, including entropy measures, can be modeled well by normal distributions. In this study, we test the normality of various qualitative variation measures in general. We find that almost all indic...

(This article belongs to the Special Issue Maximum Entropy and Its Application II)
  • Article
  • Open Access
6 Citations
5,239 Views
15 Pages

4 May 2017

In this work, we present a numerical study of the influence of matrix degrading enzyme (MDE) dynamics and haptotaxis on the development of vessel networks in tumor-induced angiogenesis. Avascular tumors produce growth factors that induce nearby blood...

(This article belongs to the Special Issue Statistical Mechanics of Complex and Disordered Systems)
  • Article
  • Open Access
15 Citations
9,895 Views
22 Pages

Coarse Graining Shannon and von Neumann Entropies

  • Ana Alonso-Serrano and
  • Matt Visser

3 May 2017

The nature of coarse graining is intuitively “obvious”, but it is rather difficult to find explicit and calculable models of the coarse graining process (and the resulting entropy flow) discussed in the literature. What we would like to have at hand...

(This article belongs to the Special Issue Black Hole Thermodynamics II)
  • Concept Paper
  • Open Access
11 Citations
9,931 Views
30 Pages

About the Concept of Quantum Chaos

  • Ignacio S. Gomez,
  • Marcelo Losada and
  • Olimpia Lombardi

3 May 2017

The research on quantum chaos finds its roots in the study of the spectrum of complex nuclei in the 1950s and the pioneering experiments in microwave billiards in the 1970s. Since then, a large number of new results was produced. Nevertheless, the wo...

(This article belongs to the Special Issue Foundations of Quantum Mechanics)
  • Article
  • Open Access
11 Citations
4,492 Views
11 Pages

3 May 2017

In this paper, we provide an entropy inference method that is based on an objective Bayesian approach for upper record values having a two-parameter logistic distribution. We derive the entropy that is based on the i-th upper record value and the joi...

  • Article
  • Open Access
27 Citations
6,290 Views
11 Pages

The Solution of Modified Fractional Bergman’s Minimal Blood Glucose-Insulin Model

  • Badr S. Alkahtani,
  • Obaid J. Algahtani,
  • Ravi S. Dubey and
  • Pranay Goswami

2 May 2017

In the present paper, we use analytical techniques to solve fractional nonlinear differential equations systems that arise in Bergman’s minimal model, used to describe blood glucose and insulin metabolism, after intravenous tolerance testing. We also...

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory II)
  • Letter
  • Open Access
5,728 Views
9 Pages

2 May 2017

We consider the rate R and variance σ 2 of Shannon information in snippets of text based on word frequencies in the natural language. We empirically identify Kolmogorov’s scaling law in σ 2 k - 1 . 66 ± 0 . 12 (95% c.l.) as a...

(This article belongs to the Special Issue Information Theory in Machine Learning and Data Science)
  • Article
  • Open Access
7 Citations
5,696 Views
22 Pages

2 May 2017

This work investigates the influence of directional properties of decoherence on kinetics rate equations. The physical reality is understood as a chain of unitary and decoherence events. The former are quantum-deterministic, while the latter introduc...

(This article belongs to the Special Issue Quantum Thermodynamics)
  • Article
  • Open Access
8 Citations
4,994 Views
11 Pages

Fractional Diffusion in a Solid with Mass Absorption

  • Yuriy Povstenko,
  • Tamara Kyrylych and
  • Grażyna Rygał

2 May 2017

The space-time-fractional diffusion equation with the Caputo time-fractional derivative and Riesz fractional Laplacian is considered in the case of axial symmetry. Mass absorption (mass release) is described by a source term proportional to concentra...

(This article belongs to the Special Issue Complex Systems, Non-Equilibrium Dynamics and Self-Organisation)
  • Article
  • Open Access
12 Citations
7,619 Views
22 Pages

Cooperative Particle Filtering for Tracking ERP Subcomponents from Multichannel EEG

  • Sadaf Monajemi,
  • Delaram Jarchi,
  • Sim-Heng Ong and
  • Saeid Sanei

29 April 2017

In this study, we propose a novel method to investigate P300 variability over different trials. The method incorporates spatial correlation between EEG channels to form a cooperative coupled particle filtering method that tracks the P300 subcomponent...

(This article belongs to the Special Issue Entropy and Electroencephalography II)
  • Article
  • Open Access
7 Citations
5,698 Views
15 Pages

29 April 2017

Iterated games, in which the same economic interaction is repeatedly played between the same agents, are an important framework for understanding the effectiveness of strategic choices over time. To date, very little work has applied information theo...

(This article belongs to the Special Issue Complexity, Criticality and Computation (C³))
  • Article
  • Open Access
58 Citations
6,467 Views
17 Pages

Effects of Movable-Baffle on Heat Transfer and Entropy Generation in a Cavity Saturated by CNT Suspensions: Three-Dimensional Modeling

  • Abdullah A.A.A. Al-Rashed,
  • Walid Aich,
  • Lioua Kolsi,
  • Omid Mahian,
  • Ahmed Kadhim Hussein and
  • Mohamed Naceur Borjini

29 April 2017

Convective heat transfer and entropy generation in a 3D closed cavity, equipped with adiabatic-driven baffle and filled with CNT (carbon nanotube)-water nanofluid, are numerically investigated for a range of Rayleigh numbers from 103 to 105. This res...

(This article belongs to the Special Issue Entropy Generation in Nanofluid Flows)
  • Article
  • Open Access
87 Citations
9,141 Views
12 Pages

28 April 2017

Permutation entropy and order patterns in an EEG signal have been applied by several authors to study sleep, anesthesia, and epileptic absences. Here, we discuss a new version of permutation entropy, which is interpreted as distance to white noise. I...

(This article belongs to the Special Issue Entropy and Sleep Disorders)
  • Article
  • Open Access
45 Citations
8,056 Views
16 Pages

Symbolic Analysis of Brain Dynamics Detects Negative Stress

  • Beatriz García-Martínez,
  • Arturo Martínez-Rodrigo,
  • Roberto Zangróniz,
  • José Manuel Pastor and
  • Raúl Alcaraz

28 April 2017

The electroencephalogram (EEG) is the most common tool used to study mental disorders. In the last years, the use of this recording for recognition of negative stress has been receiving growing attention. However, precise identification of this emoti...

(This article belongs to the Special Issue Symbolic Entropy Analysis and Its Applications)
  • Article
  • Open Access
21 Citations
7,079 Views
12 Pages

Entropy in the Tangled Nature Model of Evolution

  • Ty N. F. Roach,
  • James Nulton,
  • Paolo Sibani,
  • Forest Rohwer and
  • Peter Salamon

27 April 2017

Applications of entropy principles to evolution and ecology are of tantamount importance given the central role spatiotemporal structuring plays in both evolution and ecological succession. We obtain here a qualitative interpretation of the role of e...

(This article belongs to the Special Issue Entropy in Landscape Ecology)
  • Article
  • Open Access
17 Citations
8,300 Views
26 Pages

27 April 2017

The importance of the mean annual runoff (MAR)-hydrological variable is paramount for catchment planning, development and management. MAR depicts the amount of uncertainty or chaos (implicitly information content) of the catchment. The uncertainty as...

  • Article
  • Open Access
76 Citations
11,641 Views
12 Pages

Stochastic Stirling Engine Operating in Contact with Active Baths

  • Ruben Zakine,
  • Alexandre Solon,
  • Todd Gingrich and
  • Frédéric Van Wijland

27 April 2017

A Stirling engine made of a colloidal particle in contact with a nonequilibrium bath is considered and analyzed with the tools of stochastic energetics. We model the bath by non Gaussian persistent noise acting on the colloidal particle. Depending on...

(This article belongs to the Special Issue Thermodynamics and Statistical Mechanics of Small Systems)
  • Article
  • Open Access
37 Citations
8,820 Views
11 Pages

Criticality and Information Dynamics in Epidemiological Models

  • E. Yagmur Erten,
  • Joseph T. Lizier,
  • Mahendra Piraveenan and
  • Mikhail Prokopenko

27 April 2017

Understanding epidemic dynamics has always been a challenge. As witnessed from the ongoing Zika or the seasonal Influenza epidemics, we still need to improve our analytical methods to better understand and control epidemics. While the emergence of co...

(This article belongs to the Special Issue Complexity, Criticality and Computation (C³))
  • Article
  • Open Access
8 Citations
5,921 Views
13 Pages

Recognition of Traveling Surges in HVDC with Wavelet Entropy

  • Guomin Luo,
  • Qizhi Lin,
  • Lin Zhou and
  • Jinghan He

26 April 2017

Traveling surges are commonly adopted in protection devices of high-voltage direct current (HVDC) transmission systems. Lightning strikes also can produce large-amplitude traveling surges which lead to the malfunction of relays. To ensure the reliabl...

(This article belongs to the Special Issue Entropy in Signal Analysis)
  • Article
  • Open Access
5 Citations
4,574 Views
13 Pages

Multicomponent and Longitudinal Imaging Seen as a Communication Channel—An Application to Stroke

  • Mathilde Giacalone,
  • Carole Frindel,
  • Emmanuel Grenier and
  • David Rousseau

26 April 2017

In longitudinal medical studies, multicomponent images of the tissues, acquired at a given stage of a disease, are used to provide information on the fate of the tissues. We propose a quantification of the predictive value of multicomponent images us...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
1 Citations
5,734 Views
16 Pages

On the Anonymity Risk of Time-Varying User Profiles

  • Silvia Puglisi,
  • David Rebollo-Monedero and
  • Jordi Forné

26 April 2017

Websites and applications use personalisation services to profile their users, collect their patterns and activities and eventually use this data to provide tailored suggestions. User preferences and social interactions are therefore aggregated and a...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
103 Citations
49,965 Views
15 Pages

26 April 2017

The causal structure of any system can be analyzed at a multitude of spatial and temporal scales. It has long been thought that while higher scale (macro) descriptions may be useful to observers, they are at best a compressed description and at worse...

(This article belongs to the Section Complexity)

of 2

XFacebookLinkedIn
Entropy - ISSN 1099-4300