Skip to Content

Entropy, Volume 22, Issue 5

2020 May - 99 articles

Cover Story: This schematic illustrates the partition of a system’s states into internal states (blue) and hidden or external states (cyan) that are separated by a Markov blanket, comprising sensory (magenta) and active states (red). The upper panel shows this partition as it would be applied to action and perception in the brain. The ensuing self-organization of internal states then corresponds to perception, while action couples brain states back to external states. The lower panel shows the same dependencies but rearranged so that the internal states are associated with the intracellular states of a Bacillus, while the sensory states become the surface states or cell membrane overlying active states (e.g., the actin filaments of the cytoskeleton). View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (99)

  • Article
  • Open Access
6 Citations
5,076 Views
17 Pages

25 May 2020

Technological innovations are not enough by themselves to achieve social and environmental sustainability in companies. Sustainable development aims to determine the environmental impact of a product and the hidden price of products and services thro...

(This article belongs to the Special Issue Artificial Intelligence and Computational Methods in the Modeling of Complex Systems)
  • Article
  • Open Access
3 Citations
4,293 Views
29 Pages

25 May 2020

This paper mainly focuses on the problem of lossy compression storage based on the data value that represents the subjective assessment of users when the storage size is still not enough after the conventional lossless data compression. To this end,...

(This article belongs to the Special Issue Entropy Measures for Data Analysis II: Theory, Algorithms and Applications)
  • Article
  • Open Access
82 Citations
4,177 Views
24 Pages

25 May 2020

In this paper, we first study a new two parameter lifetime distribution. This distribution includes “monotone” and “non-monotone” hazard rate functions which are useful in lifetime data analysis and reliability. Some of its ma...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
13 Citations
5,611 Views
15 Pages

24 May 2020

The investigation of the systemic importance of financial institutions (SIFIs) has become a hot topic in the field of financial risk management. By making full use of 5-min high-frequency data, and with the help of the method of entropy weight techni...

(This article belongs to the Special Issue Complexity in Economic and Social Systems)
  • Article
  • Open Access
29 Citations
4,887 Views
23 Pages

24 May 2020

In theory, high key and high plaintext sensitivities are a must for a cryptosystem to resist the chosen/known plaintext and the differential attacks. High plaintext sensitivity can be achieved by ensuring that each encrypted result is plaintext-depen...

  • Article
  • Open Access
14 Citations
4,477 Views
25 Pages

23 May 2020

In the differential approach elaborated, we study the evolution of the parameters of Gaussian, mixed, continuous variable density matrices, whose dynamics are given by Hermitian Hamiltonians expressed as quadratic forms of the position and momentum o...

(This article belongs to the Special Issue Quantum Probability and Randomness II)
  • Article
  • Open Access
5 Citations
5,304 Views
11 Pages

23 May 2020

We study the dynamics of information processing in the continuum depth limit of deep feed-forward Neural Networks (NN) and find that it can be described in language similar to the Renormalization Group (RG). The association of concepts to patterns by...

(This article belongs to the Special Issue MaxEnt 2019—The 39th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering)
  • Article
  • Open Access
8 Citations
4,501 Views
16 Pages

22 May 2020

The symmetric positive definite (SPD) matrix has attracted much attention in classification problems because of its remarkable performance, which is due to the underlying structure of the Riemannian manifold with non-negative curvature as well as the...

  • Article
  • Open Access
4,942 Views
14 Pages

A Method to Present and Analyze Ensembles of Information Sources

  • Nicholas M. Timme,
  • David Linsenbardt and
  • Christopher C. Lapish

21 May 2020

Information theory is a powerful tool for analyzing complex systems. In many areas of neuroscience, it is now possible to gather data from large ensembles of neural variables (e.g., data from many neurons, genes, or voxels). The individual variables...

(This article belongs to the Special Issue Information Theory in Computational Neuroscience)
  • Feature Paper
  • Article
  • Open Access
68 Citations
9,674 Views
31 Pages

Probabilistic Shaping for Finite Blocklengths: Distribution Matching and Sphere Shaping

  • Yunus Can Gültekin,
  • Tobias Fehenberger,
  • Alex Alvarado and
  • Frans M. J. Willems

21 May 2020

In this paper, we provide a systematic comparison of distribution matching (DM) and sphere shaping (SpSh) algorithms for short blocklength probabilistic amplitude shaping. For asymptotically large blocklengths, constant composition distribution match...

(This article belongs to the Special Issue Information Theory for Communication Systems)
  • Article
  • Open Access
57 Citations
5,108 Views
10 Pages

A Dual Measure of Uncertainty: The Deng Extropy

  • Francesco Buono and
  • Maria Longobardi

21 May 2020

The extropy has recently been introduced as the dual concept of entropy. Moreover, in the context of the Dempster–Shafer evidence theory, Deng studied a new measure of discrimination, named the Deng entropy. In this paper, we define the Deng ex...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
30 Citations
5,145 Views
14 Pages

21 May 2020

It has been reported that major earthquakes are preceded by Seismic Electric Signals (SES). Observations show that in the natural time analysis of an earthquake (EQ) catalog, an SES activity starts when the fluctuations of the order parameter of seis...

(This article belongs to the Special Issue Entropy, Nonlinear Dynamics, and Methods of Complex Systems in Earthquake Physics including Precursory Phenomena II)
  • Article
  • Open Access
10 Citations
4,073 Views
12 Pages

21 May 2020

Determining the coupling between systems remains a topic of active research in the field of complex science. Identifying the proper causal influences in time series can already be very challenging in the trivariate case, particularly when the interac...

(This article belongs to the Special Issue Advance Methods for the Quantification of Correlations and Causal Relations between Processes)
  • Article
  • Open Access
9 Citations
5,235 Views
29 Pages

Detecting Malware with Information Complexity

  • Nadia Alshahwan,
  • Earl T. Barr,
  • David Clark,
  • George Danezis and
  • Héctor D. Menéndez

20 May 2020

Malware concealment is the predominant strategy for malware propagation. Black hats create variants of malware based on polymorphism and metamorphism. Malware variants, by definition, share some information. Although the concealment strategy alters t...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
25 Citations
5,580 Views
19 Pages

Two-Dimensional Permutation Vectors’ (PV) Code for Optical Code Division Multiple Access Systems

  • Hassan Yousif Ahmed,
  • Medien Zeghid,
  • Waqas A.Imtiaz,
  • Teena Sharma,
  • Abdellah Chehri and
  • Paul Fortier

20 May 2020

In this paper, we present a new algorithm to generate two-dimensional (2D) permutation vectors’ (PV) code for incoherent optical code division multiple access (OCDMA) system to suppress multiple access interference (MAI) and system complexity....

(This article belongs to the Special Issue Entropy-Based Algorithms for Signal Processing)
  • Article
  • Open Access
3 Citations
7,025 Views
15 Pages

Working Memory Training: Assessing the Efficiency of Mnemonic Strategies

  • Serena Di Santo,
  • Vanni De Luca,
  • Alessio Isaja and
  • Sara Andreetta

20 May 2020

Recently, there has been increasing interest in techniques for enhancing working memory (WM), casting a new light on the classical picture of a rigid system. One reason is that WM performance has been associated with intelligence and reasoning, while...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
12 Citations
5,171 Views
16 Pages

20 May 2020

This study considers the problem of detecting a change in the conditional variance of time series with time-varying volatilities based on the cumulative sum (CUSUM) of squares test using the residuals from support vector regression (SVR)-generalized...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
120 Citations
8,092 Views
19 Pages

20 May 2020

Advancements in wearable sensors technologies provide prominent effects in the daily life activities of humans. These wearable sensors are gaining more awareness in healthcare for the elderly to ensure their independent living and to improve their co...

  • Article
  • Open Access
68 Citations
7,927 Views
26 Pages

Machine Learning Based Automated Segmentation and Hybrid Feature Analysis for Diabetic Retinopathy Classification Using Fundus Image

  • Aqib Ali,
  • Salman Qadri,
  • Wali Khan Mashwani,
  • Wiyada Kumam,
  • Poom Kumam,
  • Samreen Naeem,
  • Atila Goktas,
  • Farrukh Jamal,
  • Christophe Chesneau and
  • Muhammad Sulaiman
  • + 1 author

19 May 2020

The object of this study was to demonstrate the ability of machine learning (ML) methods for the segmentation and classification of diabetic retinopathy (DR). Two-dimensional (2D) retinal fundus (RF) images were used. The datasets of DR—that is...

(This article belongs to the Special Issue Information-Theoretic Data Mining)
  • Article
  • Open Access
4 Citations
4,320 Views
12 Pages

19 May 2020

In this article, I develop a formal model of free will for complex systems based on emergent properties and adaptive selection. The model is based on a process ontology in which a free choice is a singular process that takes a system from one macrost...

(This article belongs to the Special Issue Models of Consciousness)
  • Article
  • Open Access
2 Citations
4,159 Views
14 Pages

19 May 2020

Unique k-SAT is the promised version of k-SAT where the given formula has 0 or 1 solution and is proved to be as difficult as the general k-SAT. For any k 3 , s f ( k , d ) and ( s + d ) / 2 > k 1 , a parsim...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
12 Citations
5,892 Views
16 Pages

Taylor’s Law in Innovation Processes

  • Francesca Tria,
  • Irene Crimaldi,
  • Giacomo Aletti and
  • Vito D. P. Servedio

19 May 2020

Taylor’s law quantifies the scaling properties of the fluctuations of the number of innovations occurring in open systems. Urn-based modeling schemes have already proven to be effective in modeling this complex behaviour. Here, we present analy...

(This article belongs to the Special Issue Statistical Mechanics of Complex Systems)
  • Article
  • Open Access
18 Citations
4,844 Views
15 Pages

Dynamical Complexity of the 2015 St. Patrick’s Day Magnetic Storm at Swarm Altitudes Using Entropy Measures

  • Constantinos Papadimitriou,
  • Georgios Balasis,
  • Adamantia Zoe Boutsi,
  • Ioannis A. Daglis,
  • Omiros Giannakis,
  • Anastasios Anastasiadis,
  • Paola De Michelis and
  • Giuseppe Consolini

19 May 2020

The continuously expanding toolbox of nonlinear time series analysis techniques has recently highlighted the importance of dynamical complexity to understand the behavior of the complex solar wind–magnetosphere–ionosphere–thermosphe...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
2 Citations
3,313 Views
8 Pages

19 May 2020

We use Langevin dynamics simulations to study dense 2d systems of particles with both size and energy polydispersity. We compare two types of bidisperse systems which differ in the correlation between particle size and interaction parameters: in one...

  • Article
  • Open Access
7 Citations
5,966 Views
26 Pages

19 May 2020

Estimating the parameters of the autoregressive (AR) random process is a problem that has been well-studied. In many applications, only noisy measurements of AR process are available. The effect of the additive noise is that the system can be modeled...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
14 Citations
4,376 Views
15 Pages

19 May 2020

Underwater quantumkey distribution (QKD) is tough but important formodern underwater communications in an insecure environment. It can guarantee secure underwater communication between submarines and enhance safety for critical network nodes. To enha...

(This article belongs to the Special Issue Physical-Layer Security, Quantum Key Distribution and Post-quantum Cryptography)
  • Article
  • Open Access
10 Citations
3,756 Views
16 Pages

Analysis of the Stochastic Population Model with Random Parameters

  • Adeeb Noor,
  • Ahmed Barnawi,
  • Redhwan Nour,
  • Abdullah Assiri and
  • Mohamed El-Beltagy

18 May 2020

The population models allow for a better understanding of the dynamical interactions with the environment and hence can provide a way for understanding the population changes. They are helpful in studying the biological invasions, environmental conse...

(This article belongs to the Special Issue Statistical Mechanics of Complex Systems)
  • Article
  • Open Access
22 Citations
7,004 Views
36 Pages

18 May 2020

The relative entropy and the chi-squared divergence are fundamental divergence measures in information theory and statistics. This paper is focused on a study of integral relations between the two divergences, the implications of these relations, the...

(This article belongs to the Special Issue Divergence Measures: Mathematical Foundations and Applications in Information-Theoretic and Statistical Problems)
  • Feature Paper
  • Article
  • Open Access
30 Citations
8,842 Views
26 Pages

18 May 2020

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model framework, there ar...

(This article belongs to the Special Issue Probabilistic Inference in Goal-Directed Human and Animal Decision-Making)
  • Review
  • Open Access
10 Citations
4,062 Views
33 Pages

18 May 2020

The review is devoted to two important quantities characterizing many-body systems, order indices and the measure of entanglement production. Order indices describe the type of order distinguishing statistical systems. Contrary to the order parameter...

(This article belongs to the Special Issue Quantum Many-Body Dynamics in Physics, Chemistry, and Mathematics)
  • Article
  • Open Access
9 Citations
5,761 Views
14 Pages

18 May 2020

In this article, some practical software optimization methods for implementations of fractional order backward difference, sum, and differintegral operator based on Grünwald–Letnikov definition are presented. These numerical algorithms are...

(This article belongs to the Special Issue Entropy in Dynamic Systems II)
  • Article
  • Open Access
18 Citations
5,168 Views
17 Pages

17 May 2020

During recent years our society has often been exposed to coherent information waves of high amplitudes. These are waves of huge social energy. Often they are of destructive character, a kind of information tsunami. However, they can also carry posit...

(This article belongs to the Special Issue Quantum Models of Cognition and Decision-Making)
  • Article
  • Open Access
12 Citations
5,873 Views
15 Pages

17 May 2020

This paper demonstrates a novel approach to training deep neural networks using a Mutual Information (MI)-driven, decaying Learning Rate (LR), Stochastic Gradient Descent (SGD) algorithm. MI between the output of the neural network and true outcomes...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
7 Citations
4,467 Views
12 Pages

17 May 2020

Soft-matter systems when driven out of equilibrium often give rise to structures that usually lie in between the macroscopic scale of the material and microscopic scale of its constituents. In this paper we review three such systems, the two-dimensio...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
9 Citations
3,881 Views
23 Pages

Renormalization Analysis of Topic Models

  • Sergei Koltcov and
  • Vera Ignatenko

16 May 2020

In practice, to build a machine learning model of big data, one needs to tune model parameters. The process of parameter tuning involves extremely time-consuming and computationally expensive grid search. However, the theory of statistical physics pr...

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)
  • Article
  • Open Access
5 Citations
4,233 Views
11 Pages

Storage of Energy in Constrained Non-Equilibrium Systems

  • Yirui Zhang,
  • Konrad Giżyński,
  • Anna Maciołek and
  • Robert Hołyst

16 May 2020

We study a quantity T defined as the energy U, stored in non-equilibrium steady states (NESS) over its value in equilibrium U 0 , Δ U = U U 0 divided by the heat flow J U going out of the system. A recent...

(This article belongs to the Special Issue Evolution and Thermodynamics)
  • Article
  • Open Access
29 Citations
4,835 Views
28 Pages

Crystallization of Supercooled Liquids: Self-Consistency Correction of the Steady-State Nucleation Rate

  • Alexander S. Abyzov,
  • Jürn W. P. Schmelzer,
  • Vladimir M. Fokin and
  • Edgar D. Zanotto

16 May 2020

Crystal nucleation can be described by a set of kinetic equations that appropriately account for both the thermodynamic and kinetic factors governing this process. The mathematical analysis of this set of equations allows one to formulate analytical...

(This article belongs to the Special Issue Crystallization Thermodynamics)
  • Article
  • Open Access
31 Citations
4,766 Views
17 Pages

15 May 2020

We study flow of substance in a channel of network which consists of nodes of network and edges which connect these nodes and form ways for motion of substance. The channel can have arbitrary number of arms and each arm can contain arbitrary number o...

(This article belongs to the Special Issue Condensed-Matter-Principia Based Information & Statistical Measures: From Classical to Quantum)
  • Feature Paper
  • Article
  • Open Access
3 Citations
3,043 Views
14 Pages

15 May 2020

Despite the potential benefits of reducing system costs and improving spectral efficiency, it is challenging to implement cloud radio access network (C-RAN) systems due to the performance degradation caused by finite-capacity fronthaul links and inte...

(This article belongs to the Special Issue Information Theory and 5G/6G Mobile Communications)
  • Article
  • Open Access
18 Citations
3,201 Views
12 Pages

15 May 2020

This paper presents the algorithms for solving the inverse problems on models with the fractional derivative. The presented algorithm is based on the Real Ant Colony Optimization algorithm. In this paper, the examples of the algorithm application for...

(This article belongs to the Special Issue Artificial Intelligence and Computational Methods in the Modeling of Complex Systems)
  • Article
  • Open Access
14 Citations
6,831 Views
12 Pages

Complex Extreme Sea Levels Prediction Analysis: Karachi Coast Case Study

  • Faisal Ahmed Khan,
  • Tariq Masood Ali Khan,
  • Ali Najah Ahmed,
  • Haitham Abdulmohsin Afan,
  • Mohsen Sherif,
  • Ahmed Sefelnasr and
  • Ahmed El-Shafie

14 May 2020

In this study, the analysis of the extreme sea level was carried out by using 10 years (2007–2016) of hourly tide gauge data of Karachi port station along the Pakistan coast. Observations revealed that the magnitudes of the tides usually exceed...

(This article belongs to the Special Issue Artificial Intelligence and Computational Methods in the Modeling of Complex Systems)
  • Review
  • Open Access
59 Citations
9,646 Views
39 Pages

14 May 2020

We have developed a molecular mean-field theory—fourth-order Poisson–Nernst–Planck–Bikerman theory—for modeling ionic and water flows in biological ion channels by treating ions and water molecules of any volume and shap...

(This article belongs to the Special Issue Physics of Ionic Conduction in Narrow Biological and Artificial Channels)
  • Article
  • Open Access
7 Citations
13,672 Views
35 Pages

14 May 2020

Herein we are not interested in merely using dynamical systems theory, graph theory, information theory, etc., to model the relationship between brain dynamics and networks, and various states and degrees of conscious processes. We are interested in...

(This article belongs to the Special Issue Models of Consciousness)
  • Article
  • Open Access
34 Citations
7,588 Views
24 Pages

Modules or Mean-Fields?

  • Thomas Parr,
  • Noor Sajid and
  • Karl J. Friston

14 May 2020

The segregation of neural processing into distinct streams has been interpreted by some as evidence in favour of a modular view of brain function. This implies a set of specialised ‘modules’, each of which performs a specific kind of comp...

(This article belongs to the Special Issue Statistical Physics of Living Systems)
  • Article
  • Open Access
12 Citations
4,192 Views
15 Pages

13 May 2020

The velocities of space plasma particles often follow kappa distribution functions, which have characteristic high energy tails. The tails of these distributions are associated with low particle flux and, therefore, it is challenging to precisely res...

(This article belongs to the Special Issue Entropy Measures and Applications in Astrophysics)
  • Article
  • Open Access
6 Citations
4,900 Views
18 Pages

13 May 2020

In this paper, we consider prediction and variable selection in the misspecified binary classification models under the high-dimensional scenario. We focus on two approaches to classification, which are computationally efficient, but lead to model mi...

(This article belongs to the Special Issue Nonparametric Statistical Inference with an Emphasis on Information-Theoretic Methods)
  • Article
  • Open Access
3,421 Views
11 Pages

13 May 2020

Novel measures of symbol dominance (dC1 and dC2), symbol diversity (DC1 = N (1 − dC1) and DC2 = N (1 − dC2)), and information entropy (HC1 = log2 DC1 and HC2 = log2 DC2) are derived from Lorenz-consistent statistics that I had previously...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
45 Citations
5,339 Views
30 Pages

13 May 2020

When gradient descent (GD) is scaled to many parallel workers for large-scale machine learning applications, its per-iteration computation time is limited by straggling workers. Straggling workers can be tolerated by assigning redundant computations...

(This article belongs to the Special Issue The Interplay between Storage, Computing, and Communications from an Information-Theoretic Perspective)
  • Article
  • Open Access
12 Citations
6,297 Views
17 Pages

13 May 2020

Due to various regulations (e.g., the Basel III Accord), banks need to keep a specified amount of capital to reduce the impact of their insolvency. This equity can be calculated using, e.g., the Internal Rating Approach, enabling institutions to deve...

(This article belongs to the Special Issue Statistical Machine Learning for Multimodal Data Analysis)
  • Article
  • Open Access
15 Citations
4,868 Views
53 Pages

13 May 2020

Most of chaos-based cryptosystems utilize stationary dynamics of chaos for the permutation and diffusion, and many of those are successfully attacked. In this paper, novel models of the image permutation and diffusion are proposed, in which chaotic m...

(This article belongs to the Special Issue Information Theoretic Security and Privacy of Information Systems)

of 2

XFacebookLinkedIn
Entropy - ISSN 1099-4300