Skip to Content

Entropy, Volume 20, Issue 3

2018 March - 65 articles

Cover Story: The Integrated Information Theory (IIT) proposes that in order to quantify information integration in a system as a whole, we should find the optimal part of the system where information loss by partitioning is minimized, which is called the Minimum Information Partition (MIP). Information loss is measured by integrated information (Φ), which is defined as the Kullback–Leibler divergence between the probability distribution of the system, P, and that of the partitioned system, Q. In general, searching the MIP requires an exponentially large amount of computational time. We propose an efficient algorithm that reduces the computational time to a polynomial order.
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (65)

  • Article
  • Open Access
26 Citations
5,232 Views
9 Pages

Irreversibility and Action of the Heat Conduction Process

  • Yu-Chao Hua,
  • Tiao Zhao and
  • Zeng-Yuan Guo

20 March 2018

Irreversibility (that is, the “one-sidedness” of time) of a physical process can be characterized by using Lyapunov functions in the modern theory of stability. In this theoretical framework, entropy and its production rate have been generally regard...

  • Article
  • Open Access
11 Citations
5,308 Views
13 Pages

20 March 2018

Recently, the Entropy Ensemble Filter (EEF) method was proposed to mitigate the computational cost of the Bootstrap AGGregatING (bagging) method. This method uses the most informative training data sets in the model ensemble rather than all ensemble...

  • Article
  • Open Access
94 Citations
13,627 Views
20 Pages

Deconstructing Cross-Entropy for Probabilistic Binary Classifiers

  • Daniel Ramos,
  • Javier Franco-Pedroso,
  • Alicia Lozano-Diez and
  • Joaquin Gonzalez-Rodriguez

20 March 2018

In this work, we analyze the cross-entropy function, widely used in classifiers both as a performance measure and as an optimization objective. We contextualize cross-entropy in the light of Bayesian decision theory, the formal probabilistic framewor...

  • Article
  • Open Access
10 Citations
6,844 Views
14 Pages

20 March 2018

The use of expert knowledge to quantify a Bayesian Network (BN) is necessary when data is not available. This however raises questions regarding how opinions from multiple experts can be used in a BN. Linear pooling is a popular method for combining...

  • Article
  • Open Access
201 Citations
11,194 Views
21 Pages

20 March 2018

Dispersion entropy (DispEn) is a recently introduced entropy metric to quantify the uncertainty of time series. It is fast and, so far, it has demonstrated very good performance in the characterisation of time series. It includes a mapping step, but...

  • Article
  • Open Access
2 Citations
4,129 Views
13 Pages

20 March 2018

Rough random theory, generally applied to statistics, decision-making, and so on, is an extension of rough set theory and probability theory, in which a rough random variable is described as a random variable taking “rough variable” values. In order...

  • Article
  • Open Access
5 Citations
4,920 Views
19 Pages

Output-Feedback Control for Discrete-Time Spreading Models in Complex Networks

  • Luis A. Alarcón Ramos,
  • Roberto Bernal Jaquez and
  • Alexander Schaum

19 March 2018

The problem of stabilizing the spreading process to a prescribed probability distribution over a complex network is considered, where the dynamics of the nodes in the network is given by discrete-time Markov-chain processes. Conditions for the positi...

  • Article
  • Open Access
19 Citations
6,479 Views
36 Pages

19 March 2018

A trajectory-based representation for the quantum theory of the gravitational field is formulated. This is achieved in terms of a covariant Generalized Lagrangian-Path (GLP) approach which relies on a suitable statistical representation of Bohmian La...

  • Feature Paper
  • Article
  • Open Access
3 Citations
4,776 Views
22 Pages

17 March 2018

Evaluating the performance of Bayesian classification in a high-dimensional random tensor is a fundamental problem, usually difficult and under-studied. In this work, we consider two Signal to Noise Ratio (SNR)-based binary classification problems of...

  • Article
  • Open Access
17 Citations
8,062 Views
24 Pages

16 March 2018

In this paper, the problem of low probability of intercept (LPI)-based radar waveform design for distributed multiple-radar system (DMRS) is studied, which consists of multiple radars coexisting with a wireless communication system in the same freque...

  • Article
  • Open Access
45 Citations
6,641 Views
18 Pages

Modulation Signal Recognition Based on Information Entropy and Ensemble Learning

  • Zhen Zhang,
  • Yibing Li,
  • Shanshan Jin,
  • Zhaoyue Zhang,
  • Hui Wang,
  • Lin Qi and
  • Ruolin Zhou

16 March 2018

In this paper, information entropy and ensemble learning based signal recognition theory and algorithms have been proposed. We have extracted 16 kinds of entropy features out of 9 types of modulated signals. The types of information entropy used are...

  • Article
  • Open Access
40 Citations
6,547 Views
17 Pages

16 March 2018

The perturbations of the ionosphere which are observed prior to significant earthquakes (EQs) have long been investigated and could be considered promising for short-term EQ prediction. One way to monitor ionospheric perturbations is by studying VLF/...

  • Feature Paper
  • Article
  • Open Access
10 Citations
6,390 Views
14 Pages

16 March 2018

The Leggett-Garg inequalities serve to test whether or not quantum correlations in time can be explained within a classical macrorealistic framework. We apply this test to thermodynamics and derive a set of Leggett-Garg inequalities for the statistic...

  • Article
  • Open Access
22 Citations
6,768 Views
14 Pages

16 March 2018

The simulation of complex physics models may lead to enormous computer running times. Since the simulations are expensive it is necessary to exploit the computational budget in the best possible manner. If for a few input parameter settings an output...

  • Article
  • Open Access
7 Citations
4,571 Views
22 Pages

16 March 2018

To optimize contributions of uncertain input variables on the statistical parameter of given model, e.g., reliability, global reliability sensitivity analysis (GRSA) provides an appropriate tool to quantify the effects. However, it may be difficult t...

  • Article
  • Open Access
113 Citations
9,052 Views
16 Pages

15 March 2018

In present work, the heart rate variability (HRV) characteristics, calculated by sample entropy (SampEn), were used to analyze the driving fatigue state at successive driving stages. Combined with the relative power spectrum ratio β/(θ + α), subjecti...

  • Article
  • Open Access
4 Citations
5,741 Views
16 Pages

Estimating Multivariate Discrete Distributions Using Bernstein Copulas

  • Victor Fossaluza,
  • Luís Gustavo Esteves and
  • Carlos Alberto de Bragança Pereira

14 March 2018

Measuring the dependence between random variables is one of the most fundamental problems in statistics, and therefore, determining the joint distribution of the relevant variables is crucial. Copulas have recently become an important tool for proper...

  • Article
  • Open Access
10 Citations
5,200 Views
13 Pages

14 March 2018

As the virtual mirror of complex real-time business processes of organisations’ underlying information systems, the workflow management system (WfMS) has emerged in recent decades as a new self-autonomous paradigm in the open, dynamic, distributed co...

  • Article
  • Open Access
10 Citations
4,480 Views
10 Pages

13 March 2018

We first calculate the heat capacities of the nonlinear electrodynamics (NED) black hole for fixed mass and electric charge, and the electric capacitances for fixed mass and entropy. Then, we study the properties of the Ruppeiner thermodynamic geomet...

  • Article
  • Open Access
6 Citations
4,478 Views
16 Pages

13 March 2018

This paper proposes a different approach to pinpoint the causes for which an unconditionally secure quantum bit commitment protocol cannot be realized, beyond the technical details on which the proof of Mayers’ no-go theorem is constructed. We have a...

  • Article
  • Open Access
14 Citations
3,815 Views
9 Pages

12 March 2018

This paper is concerned with invariance ( F 1 , F 2 ) -scrambled sets under iterations. The main results are an extension of the compound invariance of Li–Yorke chaos and distributional chaos. New definitions of ( F 1 , F 2 ) -s...

  • Article
  • Open Access
2 Citations
5,704 Views
15 Pages

12 March 2018

The aim of this paper is to investigate the factors influencing the Beck Depression Inventory score, the Beck Hopelessness Scale score and the Rosenberg Self-Esteem score and the relationships among the psychiatric, demographic and socio-economic var...

  • Article
  • Open Access
17 Citations
5,442 Views
15 Pages

Game Theoretic Approach for Systematic Feature Selection; Application in False Alarm Detection in Intensive Care Units

  • Fatemeh Afghah,
  • Abolfazl Razi,
  • Reza Soroushmehr,
  • Hamid Ghanbari and
  • Kayvan Najarian

12 March 2018

Intensive Care Units (ICUs) are equipped with many sophisticated sensors and monitoring devices to provide the highest quality of care for critically ill patients. However, these devices might generate false alarms that reduce standard of care and re...

  • Article
  • Open Access
19 Citations
8,114 Views
22 Pages

12 March 2018

In this paper, we examine two widely-used approaches, the polynomial chaos expansion (PCE) and Gaussian process (GP) regression, for the development of surrogate models. The theoretical differences between the PCE and GP approximations are discussed....

  • Discussion
  • Open Access
10 Citations
6,273 Views
12 Pages

11 March 2018

A critical analysis for the arguments in support of, and against, the traditional approach to thermodynamics of vitreous state is provided. In this approach one presumes that there is a continuous variation of the entropy in the glass-liquid transiti...

  • Article
  • Open Access
5 Citations
3,816 Views
13 Pages

10 March 2018

Recent progress of theories and applications regarding statistical models with generalized exponential functions in statistical science is giving an impact on the movement to deform the standard structure of information geometry. For this purpose, va...

  • Article
  • Open Access
13 Citations
5,279 Views
20 Pages

9 March 2018

Let Z be a standard Gaussian random variable, X be independent of Z, and t be a strictly positive scalar. For the derivatives in t of the differential entropy of X + t Z , McKean noticed that Gaussian X achieves the extreme for the first and...

  • Feature Paper
  • Article
  • Open Access
8 Citations
4,109 Views
14 Pages

Equilibrium States in Two-Temperature Systems

  • Evaldo M. F. Curado and
  • Fernando D. Nobre

9 March 2018

Systems characterized by more than one temperature usually appear in nonequilibrium statistical mechanics. In some cases, e.g., glasses, there is a temperature at which fast variables become thermalized, and another case associated with modes that ev...

  • Article
  • Open Access
8 Citations
4,610 Views
17 Pages

9 March 2018

Weather information is an important factor in short-term load forecasting (STLF). However, for a long time, more importance has always been attached to forecasting models instead of other processes such as the introduction of weather factors or featu...

  • Article
  • Open Access
34 Citations
8,220 Views
24 Pages

9 March 2018

We derive a lower bound on the differential entropy of a log-concave random variable X in terms of the p-th absolute moment of X. The new bound leads to a reverse entropy power inequality with an explicit constant, and to new bounds on the rate-disto...

  • Article
  • Open Access
19 Citations
6,499 Views
14 Pages

8 March 2018

Flight crew performance is of great significance in keeping flights safe and sound. When evaluating the crew performance, quantitative detailed behavior information may not be available. The present paper introduces the Bayesian Network to perform fl...

  • Article
  • Open Access
3 Citations
5,364 Views
19 Pages

Non-Conventional Thermodynamics and Models of Gradient Elasticity

  • Hans-Dieter Alber,
  • Carsten Broese,
  • Charalampos Tsakmakis and
  • Dimitri E. Beskos

8 March 2018

We consider material bodies exhibiting a response function for free energy, which depends on both the strain and its gradient. Toupin–Mindlin’s gradient elasticity is characterized by Cauchy stress tensors, which are given by space-like Euler–Lagrang...

  • Article
  • Open Access
42 Citations
8,359 Views
13 Pages

8 March 2018

In Fast Software Encryption (FSE) 2015, while presenting a new idea (i.e., the design of stream ciphers with the small internal state by using a secret key, not only in the initialization but also in the keystream generation), Sprout was proposed. Sp...

  • Article
  • Open Access
5 Citations
5,306 Views
21 Pages

8 March 2018

Rate-distortion optimization (RDO) plays an essential role in substantially enhancing the coding efficiency. Currently, rate-distortion optimized mode decision is widely used in scalable video coding (SVC). Among all the possible coding modes, it aim...

  • Article
  • Open Access
7 Citations
6,146 Views
17 Pages

Categorical Data Analysis Using a Skewed Weibull Regression Model

  • Renault Caron,
  • Debajyoti Sinha,
  • Dipak K. Dey and
  • Adriano Polpo

7 March 2018

In this paper, we present a Weibull link (skewed) model for categorical response data arising from binomial as well as multinomial model. We show that, for such types of categorical data, the most commonly used models (logit, probit and complementary...

  • Article
  • Open Access
18 Citations
5,360 Views
20 Pages

7 March 2018

We analyze the dimension of a financial correlation-based network and apply our analysis to characterize the complexity of the network. First, we generalize the volume-based dimension and find that it is well defined by the correlation-based network....

  • Article
  • Open Access
13 Citations
4,258 Views
23 Pages

Correntropy Based Matrix Completion

  • Yuning Yang,
  • Yunlong Feng and
  • Johan A. K. Suykens

6 March 2018

This paper studies the matrix completion problems when the entries are contaminated by non-Gaussian noise or outliers. The proposed approach employs a nonconvex loss function induced by the maximum correntropy criterion. With the help of this loss fu...

  • Article
  • Open Access
51 Citations
4,683 Views
14 Pages

6 March 2018

Q-neutrosophic soft sets are essentially neutrosophic soft sets characterized by three independent two-dimensional membership functions which stand for uncertainty, indeterminacy and falsity. Thus, it can be applied to two-dimensional imprecise, inde...

  • Article
  • Open Access
37 Citations
10,551 Views
22 Pages

6 March 2018

The ability to integrate information in the brain is considered to be an essential property for cognition and consciousness. Integrated Information Theory (IIT) hypothesizes that the amount of integrated information ( Φ ) in the brain is related...

  • Article
  • Open Access
4 Citations
3,241 Views
27 Pages

6 March 2018

The first- and second-order optimum achievable exponents in the simple hypothesis testing problem are investigated. The optimum achievable exponent for type II error probability, under the constraint that the type I error probability is allowed asymp...

  • Article
  • Open Access
51 Citations
6,780 Views
28 Pages

Quantifying Chaos by Various Computational Methods. Part 1: Simple Systems

  • Jan Awrejcewicz,
  • Anton V. Krysko,
  • Nikolay P. Erofeev,
  • Vitalyj Dobriyan,
  • Marina A. Barulina and
  • Vadim A. Krysko

6 March 2018

The aim of the paper was to analyze the given nonlinear problem by different methods of computation of the Lyapunov exponents (Wolf method, Rosenstein method, Kantz method, the method based on the modification of a neural network, and the synchroniza...

  • Article
  • Open Access
29 Citations
6,838 Views
19 Pages

5 March 2018

Power output ( P ), thermal efficiency ( η ) and ecological function ( E ) characteristics of an endoreversible Dual-Miller cycle (DMC) with finite speed of the piston and finite rate of heat transfer are investigated by applying finite t...

  • Feature Paper
  • Article
  • Open Access
4,192 Views
11 Pages

Statistics of Correlations and Fluctuations in a Stochastic Model of Wealth Exchange

  • Maria Letizia Bertotti,
  • Amit K. Chattopadhyay and
  • Giovanni Modanese

5 March 2018

In our recently proposed stochastic version of discretized kinetic theory, the exchange of wealth in a society is modelled through a large system of Langevin equations. The deterministic part of the equations is based on non-linear transition probabi...

  • Article
  • Open Access
23 Citations
5,924 Views
13 Pages

5 March 2018

An irreversible Maisotsenko reciprocating Brayton cycle (MRBC) model is established using the finite time thermodynamic (FTT) theory and taking the heat transfer loss (HTL), piston friction loss (PFL), and internal irreversible losses (IILs) into con...

  • Article
  • Open Access
2 Citations
4,441 Views
28 Pages

5 March 2018

An important issue for robust inference is to examine the stability of the asymptotic level and power of the test statistic in the presence of contaminated data. Most existing results are derived in finite-dimensional settings with some particular ch...

  • Feature Paper
  • Article
  • Open Access
7 Citations
6,397 Views
41 Pages

5 March 2018

Understanding how different information sources together transmit information is crucial in many domains. For example, understanding the neural code requires characterizing how different neurons contribute unique, redundant, or synergistic pieces of...

  • Feature Paper
  • Article
  • Open Access
15 Citations
4,755 Views
13 Pages

Quantifying Chaos by Various Computational Methods. Part 2: Vibrations of the Bernoulli–Euler Beam Subjected to Periodic and Colored Noise

  • Jan Awrejcewicz,
  • Anton V. Krysko,
  • Nikolay P. Erofeev,
  • Vitalyi Dobriyan,
  • Marina A. Barulina and
  • Vadim A. Krysko

5 March 2018

In this part of the paper, the theory of nonlinear dynamics of flexible Euler–Bernoulli beams (the kinematic model of the first-order approximation) under transverse harmonic load and colored noise has been proposed. It has been shown that the introd...

  • Feature Paper
  • Article
  • Open Access
14 Citations
4,593 Views
26 Pages

4 March 2018

In this article, we study computational uncertainties in probabilistic risk/safety assessment resulting from the computational complexity of calculations of risk indicators. We argue that the risk analyst faces the fundamental epistemic and aleatory...

  • Article
  • Open Access
28 Citations
6,950 Views
26 Pages

4 March 2018

We propose a variational formulation for the nonequilibrium thermodynamics of discrete open systems, i.e., discrete systems which can exchange mass and heat with the exterior. Our approach is based on a general variational formulation for systems wit...

  • Article
  • Open Access
2 Citations
3,704 Views
19 Pages

4 March 2018

This study investigated the uncertainty of the multistage assembly process from the viewpoint of a stream of defects in the product assembly process. The vulnerable spots were analyzed and the fluctuations were controlled during this process. An unce...

of 2

Get Alerted

Add your email address to receive forthcoming issues of this journal.

XFacebookLinkedIn
Entropy - ISSN 1099-4300