Skip to Content

Entropy, Volume 20, Issue 3

2018 March - 65 articles

Cover Story: The Integrated Information Theory (IIT) proposes that in order to quantify information integration in a system as a whole, we should find the optimal part of the system where information loss by partitioning is minimized, which is called the Minimum Information Partition (MIP). Information loss is measured by integrated information (Φ), which is defined as the Kullback–Leibler divergence between the probability distribution of the system, P, and that of the partitioned system, Q. In general, searching the MIP requires an exponentially large amount of computational time. We propose an efficient algorithm that reduces the computational time to a polynomial order.
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (65)

  • Article
  • Open Access
26 Citations
5,576 Views
9 Pages

Irreversibility and Action of the Heat Conduction Process

  • Yu-Chao Hua,
  • Tiao Zhao and
  • Zeng-Yuan Guo

20 March 2018

Irreversibility (that is, the “one-sidedness” of time) of a physical process can be characterized by using Lyapunov functions in the modern theory of stability. In this theoretical framework, entropy and its production rate have been generally regard...

(This article belongs to the Special Issue Phenomenological Thermodynamics of Irreversible Processes)
  • Article
  • Open Access
12 Citations
5,605 Views
13 Pages

20 March 2018

Recently, the Entropy Ensemble Filter (EEF) method was proposed to mitigate the computational cost of the Bootstrap AGGregatING (bagging) method. This method uses the most informative training data sets in the model ensemble rather than all ensemble...

(This article belongs to the Special Issue Entropy Applications in Environmental and Water Engineering)
  • Article
  • Open Access
105 Citations
15,081 Views
20 Pages

Deconstructing Cross-Entropy for Probabilistic Binary Classifiers

  • Daniel Ramos,
  • Javier Franco-Pedroso,
  • Alicia Lozano-Diez and
  • Joaquin Gonzalez-Rodriguez

20 March 2018

In this work, we analyze the cross-entropy function, widely used in classifiers both as a performance measure and as an optimization objective. We contextualize cross-entropy in the light of Bayesian decision theory, the formal probabilistic framewor...

(This article belongs to the Special Issue Entropy-based Data Mining)
  • Article
  • Open Access
11 Citations
7,483 Views
14 Pages

20 March 2018

The use of expert knowledge to quantify a Bayesian Network (BN) is necessary when data is not available. This however raises questions regarding how opinions from multiple experts can be used in a BN. Linear pooling is a popular method for combining...

(This article belongs to the Special Issue Foundations of Statistics)
  • Article
  • Open Access
218 Citations
12,521 Views
21 Pages

20 March 2018

Dispersion entropy (DispEn) is a recently introduced entropy metric to quantify the uncertainty of time series. It is fast and, so far, it has demonstrated very good performance in the characterisation of time series. It includes a mapping step, but...

(This article belongs to the Special Issue Entropy in Signal Analysis)
  • Article
  • Open Access
2 Citations
4,312 Views
13 Pages

20 March 2018

Rough random theory, generally applied to statistics, decision-making, and so on, is an extension of rough set theory and probability theory, in which a rough random variable is described as a random variable taking “rough variable” values. In order...

(This article belongs to the Special Issue Entropy and Information Inequalities)
  • Article
  • Open Access
5 Citations
5,190 Views
19 Pages

Output-Feedback Control for Discrete-Time Spreading Models in Complex Networks

  • Luis A. Alarcón Ramos,
  • Roberto Bernal Jaquez and
  • Alexander Schaum

19 March 2018

The problem of stabilizing the spreading process to a prescribed probability distribution over a complex network is considered, where the dynamics of the nodes in the network is given by discrete-time Markov-chain processes. Conditions for the positi...

(This article belongs to the Special Issue Research Frontier in Chaos Theory and Complex Networks)
  • Article
  • Open Access
19 Citations
6,885 Views
36 Pages

19 March 2018

A trajectory-based representation for the quantum theory of the gravitational field is formulated. This is achieved in terms of a covariant Generalized Lagrangian-Path (GLP) approach which relies on a suitable statistical representation of Bohmian La...

(This article belongs to the Special Issue Emergent Quantum Mechanics – David Bohm Centennial Perspectives)
  • Feature Paper
  • Article
  • Open Access
3 Citations
5,121 Views
22 Pages

17 March 2018

Evaluating the performance of Bayesian classification in a high-dimensional random tensor is a fundamental problem, usually difficult and under-studied. In this work, we consider two Signal to Noise Ratio (SNR)-based binary classification problems of...

  • Article
  • Open Access
20 Citations
9,228 Views
24 Pages

16 March 2018

In this paper, the problem of low probability of intercept (LPI)-based radar waveform design for distributed multiple-radar system (DMRS) is studied, which consists of multiple radars coexisting with a wireless communication system in the same freque...

(This article belongs to the Special Issue Radar and Information Theory)
  • Article
  • Open Access
45 Citations
7,118 Views
18 Pages

Modulation Signal Recognition Based on Information Entropy and Ensemble Learning

  • Zhen Zhang,
  • Yibing Li,
  • Shanshan Jin,
  • Zhaoyue Zhang and ,
  • Hui Wang,
  • Lin Qi and
  • Ruolin Zhou
  • + 2 authors+ 0 author

16 March 2018

In this paper, information entropy and ensemble learning based signal recognition theory and algorithms have been proposed. We have extracted 16 kinds of entropy features out of 9 types of modulated signals. The types of information entropy used are...

(This article belongs to the Special Issue Radar and Information Theory)
  • Article
  • Open Access
40 Citations
6,887 Views
17 Pages

16 March 2018

The perturbations of the ionosphere which are observed prior to significant earthquakes (EQs) have long been investigated and could be considered promising for short-term EQ prediction. One way to monitor ionospheric perturbations is by studying VLF/...

(This article belongs to the Special Issue Entropy, Nonlinear Dynamics, and Methods of Complex Systems in Earthquake Physics including Precursory Phenomena)
  • Feature Paper
  • Article
  • Open Access
11 Citations
6,873 Views
14 Pages

16 March 2018

The Leggett-Garg inequalities serve to test whether or not quantum correlations in time can be explained within a classical macrorealistic framework. We apply this test to thermodynamics and derive a set of Leggett-Garg inequalities for the statistic...

(This article belongs to the Special Issue Quantum Thermodynamics II)
  • Article
  • Open Access
24 Citations
7,502 Views
14 Pages

16 March 2018

The simulation of complex physics models may lead to enormous computer running times. Since the simulations are expensive it is necessary to exploit the computational budget in the best possible manner. If for a few input parameter settings an output...

(This article belongs to the Special Issue MaxEnt 2017 - The 37th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering)
  • Article
  • Open Access
7 Citations
4,898 Views
22 Pages

16 March 2018

To optimize contributions of uncertain input variables on the statistical parameter of given model, e.g., reliability, global reliability sensitivity analysis (GRSA) provides an appropriate tool to quantify the effects. However, it may be difficult t...

(This article belongs to the Special Issue Maximum Entropy and Its Application II)
  • Article
  • Open Access
125 Citations
9,658 Views
16 Pages

15 March 2018

In present work, the heart rate variability (HRV) characteristics, calculated by sample entropy (SampEn), were used to analyze the driving fatigue state at successive driving stages. Combined with the relative power spectrum ratio β/(θ + α), subjecti...

  • Article
  • Open Access
4 Citations
6,102 Views
16 Pages

Estimating Multivariate Discrete Distributions Using Bernstein Copulas

  • Victor Fossaluza,
  • Luís Gustavo Esteves and
  • Carlos Alberto de Bragança Pereira

14 March 2018

Measuring the dependence between random variables is one of the most fundamental problems in statistics, and therefore, determining the joint distribution of the relevant variables is crucial. Copulas have recently become an important tool for proper...

(This article belongs to the Special Issue MaxEnt 2017 - The 37th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering)
  • Article
  • Open Access
10 Citations
5,483 Views
13 Pages

14 March 2018

As the virtual mirror of complex real-time business processes of organisations’ underlying information systems, the workflow management system (WfMS) has emerged in recent decades as a new self-autonomous paradigm in the open, dynamic, distributed co...

  • Article
  • Open Access
11 Citations
4,827 Views
10 Pages

13 March 2018

We first calculate the heat capacities of the nonlinear electrodynamics (NED) black hole for fixed mass and electric charge, and the electric capacitances for fixed mass and entropy. Then, we study the properties of the Ruppeiner thermodynamic geomet...

(This article belongs to the Special Issue Geometry in Thermodynamics II)
  • Article
  • Open Access
6 Citations
4,868 Views
16 Pages

13 March 2018

This paper proposes a different approach to pinpoint the causes for which an unconditionally secure quantum bit commitment protocol cannot be realized, beyond the technical details on which the proof of Mayers’ no-go theorem is constructed. We have a...

(This article belongs to the Special Issue Quantum Probability and Randomness)
  • Article
  • Open Access
14 Citations
4,127 Views
9 Pages

12 March 2018

This paper is concerned with invariance ( F 1 , F 2 ) -scrambled sets under iterations. The main results are an extension of the compound invariance of Li–Yorke chaos and distributional chaos. New definitions of ( F 1 , F 2 ) -s...

(This article belongs to the Special Issue Research Frontier in Chaos Theory and Complex Networks)
  • Article
  • Open Access
2 Citations
6,030 Views
15 Pages

12 March 2018

The aim of this paper is to investigate the factors influencing the Beck Depression Inventory score, the Beck Hopelessness Scale score and the Rosenberg Self-Esteem score and the relationships among the psychiatric, demographic and socio-economic var...

(This article belongs to the Special Issue Foundations of Statistics)
  • Article
  • Open Access
18 Citations
5,726 Views
15 Pages

Game Theoretic Approach for Systematic Feature Selection; Application in False Alarm Detection in Intensive Care Units

  • Fatemeh Afghah,
  • Abolfazl Razi,
  • Reza Soroushmehr,
  • Hamid Ghanbari and
  • Kayvan Najarian

12 March 2018

Intensive Care Units (ICUs) are equipped with many sophisticated sensors and monitoring devices to provide the highest quality of care for critically ill patients. However, these devices might generate false alarms that reduce standard of care and re...

(This article belongs to the Special Issue Information Theory in Game Theory)
  • Article
  • Open Access
21 Citations
9,434 Views
22 Pages

12 March 2018

In this paper, we examine two widely-used approaches, the polynomial chaos expansion (PCE) and Gaussian process (GP) regression, for the development of surrogate models. The theoretical differences between the PCE and GP approximations are discussed....

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Discussion
  • Open Access
13 Citations
6,658 Views
12 Pages

11 March 2018

A critical analysis for the arguments in support of, and against, the traditional approach to thermodynamics of vitreous state is provided. In this approach one presumes that there is a continuous variation of the entropy in the glass-liquid transiti...

(This article belongs to the Special Issue Residual Entropy and Nonequilibrium States)
  • Article
  • Open Access
5 Citations
4,249 Views
13 Pages

10 March 2018

Recent progress of theories and applications regarding statistical models with generalized exponential functions in statistical science is giving an impact on the movement to deform the standard structure of information geometry. For this purpose, va...

(This article belongs to the Special Issue New Trends in Statistical Physics of Complex Systems)
  • Article
  • Open Access
14 Citations
5,644 Views
20 Pages

9 March 2018

Let Z be a standard Gaussian random variable, X be independent of Z, and t be a strictly positive scalar. For the derivatives in t of the differential entropy of X + t Z , McKean noticed that Gaussian X achieves the extreme for the first and...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
8 Citations
4,501 Views
14 Pages

Equilibrium States in Two-Temperature Systems

  • Evaldo M. F. Curado and
  • Fernando D. Nobre

9 March 2018

Systems characterized by more than one temperature usually appear in nonequilibrium statistical mechanics. In some cases, e.g., glasses, there is a temperature at which fast variables become thermalized, and another case associated with modes that ev...

(This article belongs to the Special Issue New Trends in Statistical Physics of Complex Systems)
  • Article
  • Open Access
10 Citations
4,893 Views
17 Pages

9 March 2018

Weather information is an important factor in short-term load forecasting (STLF). However, for a long time, more importance has always been attached to forecasting models instead of other processes such as the introduction of weather factors or featu...

  • Article
  • Open Access
35 Citations
8,895 Views
24 Pages

9 March 2018

We derive a lower bound on the differential entropy of a log-concave random variable X in terms of the p-th absolute moment of X. The new bound leads to a reverse entropy power inequality with an explicit constant, and to new bounds on the rate-disto...

(This article belongs to the Special Issue Entropy and Information Inequalities)
  • Article
  • Open Access
20 Citations
6,897 Views
14 Pages

8 March 2018

Flight crew performance is of great significance in keeping flights safe and sound. When evaluating the crew performance, quantitative detailed behavior information may not be available. The present paper introduces the Bayesian Network to perform fl...

(This article belongs to the Special Issue Maximum Entropy and Bayesian Methods)
  • Article
  • Open Access
4 Citations
5,739 Views
19 Pages

Non-Conventional Thermodynamics and Models of Gradient Elasticity

  • Hans-Dieter Alber,
  • Carsten Broese,
  • Charalampos Tsakmakis and
  • Dimitri E. Beskos

8 March 2018

We consider material bodies exhibiting a response function for free energy, which depends on both the strain and its gradient. Toupin–Mindlin’s gradient elasticity is characterized by Cauchy stress tensors, which are given by space-like Euler–Lagrang...

(This article belongs to the Special Issue Phenomenological Thermodynamics of Irreversible Processes)
  • Article
  • Open Access
46 Citations
9,160 Views
13 Pages

8 March 2018

In Fast Software Encryption (FSE) 2015, while presenting a new idea (i.e., the design of stream ciphers with the small internal state by using a secret key, not only in the initialization but also in the keystream generation), Sprout was proposed. Sp...

(This article belongs to the Special Issue Information Theory and 5G Technologies)
  • Article
  • Open Access
5 Citations
5,607 Views
21 Pages

8 March 2018

Rate-distortion optimization (RDO) plays an essential role in substantially enhancing the coding efficiency. Currently, rate-distortion optimized mode decision is widely used in scalable video coding (SVC). Among all the possible coding modes, it aim...

(This article belongs to the Special Issue Rate-Distortion Theory and Information Theory)
  • Article
  • Open Access
8 Citations
6,483 Views
17 Pages

Categorical Data Analysis Using a Skewed Weibull Regression Model

  • Renault Caron,
  • Debajyoti Sinha,
  • Dipak K. Dey and
  • Adriano Polpo

7 March 2018

In this paper, we present a Weibull link (skewed) model for categorical response data arising from binomial as well as multinomial model. We show that, for such types of categorical data, the most commonly used models (logit, probit and complementary...

(This article belongs to the Special Issue MaxEnt 2017 - The 37th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering)
  • Article
  • Open Access
18 Citations
5,664 Views
20 Pages

7 March 2018

We analyze the dimension of a financial correlation-based network and apply our analysis to characterize the complexity of the network. First, we generalize the volume-based dimension and find that it is well defined by the correlation-based network....

  • Article
  • Open Access
14 Citations
4,474 Views
23 Pages

Correntropy Based Matrix Completion

  • Yuning Yang,
  • Yunlong Feng and
  • Johan A. K. Suykens

6 March 2018

This paper studies the matrix completion problems when the entries are contaminated by non-Gaussian noise or outliers. The proposed approach employs a nonconvex loss function induced by the maximum correntropy criterion. With the help of this loss fu...

(This article belongs to the Special Issue Entropy in Signal Analysis)
  • Article
  • Open Access
58 Citations
5,081 Views
14 Pages

6 March 2018

Q-neutrosophic soft sets are essentially neutrosophic soft sets characterized by three independent two-dimensional membership functions which stand for uncertainty, indeterminacy and falsity. Thus, it can be applied to two-dimensional imprecise, inde...

(This article belongs to the Special Issue Information Theory in Machine Learning and Data Science)
  • Article
  • Open Access
42 Citations
11,363 Views
22 Pages

6 March 2018

The ability to integrate information in the brain is considered to be an essential property for cognition and consciousness. Integrated Information Theory (IIT) hypothesizes that the amount of integrated information ( Φ ) in the brain is related...

(This article belongs to the Special Issue Information Theory in Neuroscience)
  • Article
  • Open Access
4 Citations
3,552 Views
27 Pages

6 March 2018

The first- and second-order optimum achievable exponents in the simple hypothesis testing problem are investigated. The optimum achievable exponent for type II error probability, under the constraint that the type I error probability is allowed asymp...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
54 Citations
7,548 Views
28 Pages

Quantifying Chaos by Various Computational Methods. Part 1: Simple Systems

  • Jan Awrejcewicz,
  • Anton V. Krysko,
  • Nikolay P. Erofeev,
  • Vitalyj Dobriyan and ,
  • Marina A. Barulina and
  • Vadim A. Krysko
  • + 1 author+ 0 author

6 March 2018

The aim of the paper was to analyze the given nonlinear problem by different methods of computation of the Lyapunov exponents (Wolf method, Rosenstein method, Kantz method, the method based on the modification of a neural network, and the synchroniza...

(This article belongs to the Special Issue Entropy in Dynamic Systems)
  • Article
  • Open Access
29 Citations
7,186 Views
19 Pages

5 March 2018

Power output ( P ), thermal efficiency ( η ) and ecological function ( E ) characteristics of an endoreversible Dual-Miller cycle (DMC) with finite speed of the piston and finite rate of heat transfer are investigated by applying finite t...

(This article belongs to the Section Thermodynamics)
  • Feature Paper
  • Article
  • Open Access
4,522 Views
11 Pages

Statistics of Correlations and Fluctuations in a Stochastic Model of Wealth Exchange

  • Maria Letizia Bertotti,
  • Amit K. Chattopadhyay and
  • Giovanni Modanese

5 March 2018

In our recently proposed stochastic version of discretized kinetic theory, the exchange of wealth in a society is modelled through a large system of Langevin equations. The deterministic part of the equations is based on non-linear transition probabi...

(This article belongs to the Special Issue Theoretical Aspect of Nonlinear Statistical Physics)
  • Article
  • Open Access
25 Citations
6,232 Views
13 Pages

5 March 2018

An irreversible Maisotsenko reciprocating Brayton cycle (MRBC) model is established using the finite time thermodynamic (FTT) theory and taking the heat transfer loss (HTL), piston friction loss (PFL), and internal irreversible losses (IILs) into con...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
2 Citations
4,768 Views
28 Pages

5 March 2018

An important issue for robust inference is to examine the stability of the asymptotic level and power of the test statistic in the presence of contaminated data. Most existing results are derived in finite-dimensional settings with some particular ch...

(This article belongs to the Special Issue New Developments in Statistical Information Theory Based on Entropy and Divergence Measures)
  • Feature Paper
  • Article
  • Open Access
8 Citations
6,845 Views
41 Pages

5 March 2018

Understanding how different information sources together transmit information is crucial in many domains. For example, understanding the neural code requires characterizing how different neurons contribute unique, redundant, or synergistic pieces of...

(This article belongs to the Special Issue Information Theory in Neuroscience)
  • Feature Paper
  • Article
  • Open Access
16 Citations
5,205 Views
13 Pages

Quantifying Chaos by Various Computational Methods. Part 2: Vibrations of the Bernoulli–Euler Beam Subjected to Periodic and Colored Noise

  • Jan Awrejcewicz,
  • Anton V. Krysko,
  • Nikolay P. Erofeev,
  • Vitalyi Dobriyan and ,
  • Marina A. Barulina and
  • Vadim A. Krysko
  • + 1 author+ 0 author

5 March 2018

In this part of the paper, the theory of nonlinear dynamics of flexible Euler–Bernoulli beams (the kinematic model of the first-order approximation) under transverse harmonic load and colored noise has been proposed. It has been shown that the introd...

(This article belongs to the Special Issue Entropy in Dynamic Systems)
  • Feature Paper
  • Article
  • Open Access
14 Citations
5,049 Views
26 Pages

4 March 2018

In this article, we study computational uncertainties in probabilistic risk/safety assessment resulting from the computational complexity of calculations of risk indicators. We argue that the risk analyst faces the fundamental epistemic and aleatory...

(This article belongs to the Special Issue Entropy for Characterization of Uncertainty in Risk and Reliability)
  • Article
  • Open Access
30 Citations
7,658 Views
26 Pages

4 March 2018

We propose a variational formulation for the nonequilibrium thermodynamics of discrete open systems, i.e., discrete systems which can exchange mass and heat with the exterior. Our approach is based on a general variational formulation for systems wit...

(This article belongs to the Special Issue Phenomenological Thermodynamics of Irreversible Processes)
  • Article
  • Open Access
2 Citations
3,940 Views
19 Pages

4 March 2018

This study investigated the uncertainty of the multistage assembly process from the viewpoint of a stream of defects in the product assembly process. The vulnerable spots were analyzed and the fluctuations were controlled during this process. An unce...

of 2

XFacebookLinkedIn
Entropy - ISSN 1099-4300