Skip to Content
You are currently on the new version of our website. Access the old version .

Entropy, Volume 22, Issue 1

2020 January - 127 articles

Cover Story: Optimal lossy data compression minimizes the storage cost of a data set X while retaining a given amount of information as possible about something (Y) that you care about. For example, what aspects of an image X contain the most information about whether it depicts a cat or not?
We present a method for efficiently solving this problem and apply it to the CIFAR-10, MNIST, and Fashion-MNIST datasets, illustrating how it can be interpreted as an information-theoretically optimal image clustering algorithm. For merely a handful of clusters, compressing the image into a single integer specifying its cluster number retains almost all the information about its class label Y. View this paper.
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (127)

  • Article
  • Open Access
6 Citations
4,382 Views
19 Pages

20 January 2020

Compressed sensing (CS) offers a framework for image acquisition, which has excellent potential in image sampling and compression applications due to the sub-Nyquist sampling rate and low complexity. In engineering practices, the resulting CS samples...

(This article belongs to the Section Signal and Data Analysis)
  • Article
  • Open Access
76 Citations
14,670 Views
14 Pages

20 January 2020

The use of Project Gutenberg (PG) as a text corpus has been extremely popular in statistical analysis of language for more than 25 years. However, in contrast to other major linguistic datasets of similar importance, no consensual full version of PG...

(This article belongs to the Special Issue Information Theory and Language)
  • Article
  • Open Access
7 Citations
5,093 Views
13 Pages

Eigenvalues of Two-State Quantum Walks Induced by the Hadamard Walk

  • Shimpei Endo,
  • Takako Endo,
  • Takashi Komatsu and
  • Norio Konno

20 January 2020

Existence of the eigenvalues of the discrete-time quantum walks is deeply related to localization of the walks. We revealed, for the first time, the distributions of the eigenvalues given by the splitted generating function method (the SGF method) of...

(This article belongs to the Special Issue Quantum Walks and Related Issues)
  • Article
  • Open Access
12 Citations
4,426 Views
12 Pages

19 January 2020

We study the q-voter model with flexibility, which allows for describing a broad spectrum of independence from zealots, inflexibility, or stubbornness through noisy voters to self-anticonformity. Analyzing the model within the pair approximation allo...

(This article belongs to the Special Issue Statistical Mechanics of Complex Systems)
  • Article
  • Open Access
5 Citations
5,872 Views
27 Pages

19 January 2020

This paper studies the problem of tangible assets acquisition within the company by proposing a new hybrid model that uses linear programming and fuzzy numbers. Regarding linear programming, two methods were implemented in the model, namely: the grap...

(This article belongs to the Special Issue Information Theories Based on Belief Functions for Decision-Making Support)
  • Article
  • Open Access
25 Citations
4,559 Views
15 Pages

19 January 2020

In this study, the design of an adaptive terminal sliding mode controller for the stabilization of port Hamiltonian chaotic systems with hidden attractors is proposed. This study begins with the design methodology of a chaotic oscillator with a hidde...

(This article belongs to the Special Issue Nonlinear Dynamics and Entropy of Complex Systems with Hidden and Self-Excited Attractors II)
  • Article
  • Open Access
15 Citations
4,723 Views
12 Pages

Analyzing Uncertainty in Complex Socio-Ecological Networks

  • Ana D. Maldonado,
  • María Morales,
  • Pedro A. Aguilera and
  • Antonio Salmerón

19 January 2020

Socio-ecological systems are recognized as complex adaptive systems whose multiple interactions might change as a response to external or internal changes. Due to its complexity, the behavior of the system is often uncertain. Bayesian networks provid...

(This article belongs to the Special Issue Computation in Complex Networks)
  • Article
  • Open Access
20 Citations
5,481 Views
17 Pages

Association between Mean Heart Rate and Recurrence Quantification Analysis of Heart Rate Variability in End-Stage Renal Disease

  • Martín Calderón-Juárez,
  • Gertrudis Hortensia González-Gómez,
  • Juan C. Echeverría,
  • Héctor Pérez-Grovas and
  • Claudia Lerma

18 January 2020

Linear heart rate variability (HRV) indices are dependent on the mean heart rate, which has been demonstrated in different models (from sinoatrial cells to humans). The association between nonlinear HRV indices, including those provided by recurrence...

  • Article
  • Open Access
30 Citations
5,831 Views
20 Pages

Permutation Entropy and Statistical Complexity in Mild Cognitive Impairment and Alzheimer’s Disease: An Analysis Based on Frequency Bands

  • Ignacio Echegoyen,
  • David López-Sanz,
  • Johann H. Martínez,
  • Fernando Maestú and
  • Javier M. Buldú

18 January 2020

We present one of the first applications of Permutation Entropy (PE) and Statistical Complexity (SC) (measured as the product of PE and Jensen-Shanon Divergence) on Magnetoencephalography (MEG) recordings of 46 subjects suffering from Mild Cognitive...

(This article belongs to the Special Issue Permutation Entropy: Theory and Applications)
  • Article
  • Open Access
8 Citations
5,343 Views
15 Pages

18 January 2020

Temperature influences the life of many organisms in various ways. A great number of organisms live under conditions where their ability to adapt to changes in temperature can be vital and largely determines their fitness. Understanding the mechanism...

(This article belongs to the Special Issue Information Flow and Entropy Production in Biomolecular Networks)
  • Article
  • Open Access
45 Citations
6,520 Views
22 Pages

Entropy-Based Image Fusion with Joint Sparse Representation and Rolling Guidance Filter

  • Yudan Liu,
  • Xiaomin Yang,
  • Rongzhu Zhang,
  • Marcelo Keese Albertini and ,
  • Turgay Celik and
  • Gwanggil Jeon
  • + 1 author+ 0 author

18 January 2020

Image fusion is a very practical technology that can be applied in many fields, such as medicine, remote sensing and surveillance. An image fusion method using multi-scale decomposition and joint sparse representation is introduced in this paper. Fir...

(This article belongs to the Special Issue Entropy-Based Algorithms for Signal Processing)
  • Article
  • Open Access
14 Citations
4,709 Views
20 Pages

Activeness and Loyalty Analysis in Event-Based Social Networks

  • Thanh Trinh,
  • Dingming Wu,
  • Joshua Zhexue Huang and
  • Muhammad Azhar

18 January 2020

Event-based social networks (EBSNs) are widely used to create online social groups and organize offline events for users. Activeness and loyalty are crucial characteristics of these online social groups in terms of determining the growth or inactiven...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
28 Citations
4,688 Views
17 Pages

17 January 2020

Driving safety in tunnels has always been an issue of great concern. Establishing delineators to improve drivers’ instantaneous cognition of the surrounding environment in tunnels can effectively enhance driver safety. Through a simulation stud...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
16 Citations
6,039 Views
19 Pages

Energy and Exergy Evaluation of a Two-Stage Axial Vapour Compressor on the LNG Carrier

  • Igor Poljak,
  • Josip Orović,
  • Vedran Mrzljak and
  • Dean Bernečić

17 January 2020

Data from a two-stage axial vapor cryogenic compressor on the dual-fuel diesel–electric (DFDE) liquefied natural gas (LNG) carrier were measured and analyzed to investigate compressor energy and exergy efficiency in real exploitation conditions...

(This article belongs to the Special Issue Carnot Cycle and Heat Engine Fundamentals and Applications)
  • Feature Paper
  • Article
  • Open Access
24 Citations
6,642 Views
19 Pages

Learning in Feedforward Neural Networks Accelerated by Transfer Entropy

  • Adrian Moldovan,
  • Angel Caţaron and
  • Răzvan Andonie

16 January 2020

Current neural networks architectures are many times harder to train because of the increasing size and complexity of the used datasets. Our objective is to design more efficient training algorithms utilizing causal relationships inferred from neural...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
5 Citations
4,334 Views
12 Pages

Complexity of Cardiotocographic Signals as A Predictor of Labor

  • João Monteiro-Santos,
  • Teresa Henriques,
  • Inês Nunes,
  • Célia Amorim-Costa and ,
  • João Bernardes and
  • Cristina Costa-Santos
  • + 1 author+ 0 author

16 January 2020

Prediction of labor is of extreme importance in obstetric care to allow for preventive measures, assuring that both baby and mother have the best possible care. In this work, the authors studied how important nonlinear parameters (entropy and compres...

(This article belongs to the Special Issue Assessing Complexity in Physiological Systems through Biomedical Signals Analysis)
  • Article
  • Open Access
17 Citations
6,078 Views
14 Pages

Determining the Bulk Parameters of Plasma Electrons from Pitch-Angle Distribution Measurements

  • Georgios Nicolaou,
  • Robert Wicks,
  • George Livadiotis,
  • Daniel Verscharen and ,
  • Christopher Owen and
  • Dhiren Kataria
  • + 1 author+ 0 author

16 January 2020

Electrostatic analysers measure the flux of plasma particles in velocity space and determine their velocity distribution function. There are occasions when science objectives require high time-resolution measurements, and the instrument operates in s...

(This article belongs to the Special Issue Theoretical Aspects of Kappa Distributions)
  • Article
  • Open Access
3 Citations
6,715 Views
26 Pages

16 January 2020

Sources that generate symbolic sequences with algorithmic nature may differ in statistical complexity because they create structures that follow algorithmic schemes, rather than generating symbols from a probabilistic function assuming independence....

(This article belongs to the Special Issue Shannon Information and Kolmogorov Complexity)
  • Article
  • Open Access
8 Citations
3,554 Views
15 Pages

Spatio-Temporal Evolution Analysis of Drought Based on Cloud Transformation Algorithm over Northern Anhui Province

  • Xia Bai,
  • Yimin Wang,
  • Juliang Jin,
  • Shaowei Ning and ,
  • Yanfang Wang and
  • Chengguo Wu
  • + 1 author+ 0 author

16 January 2020

Drought is one of the most typical and serious natural disasters, which occurs frequently in most of mainland China, and it is crucial to explore the evolution characteristics of drought for developing effective schemes and strategies of drought disa...

(This article belongs to the Special Issue Spatial Information Theory)
  • Article
  • Open Access
8 Citations
4,373 Views
32 Pages

16 January 2020

Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome’s plausibility. Information measures based on Shannon&rsqu...

  • Article
  • Open Access
8 Citations
6,085 Views
15 Pages

Visual Analysis on Information Theory and Science of Complexity Approaches in Healthcare Research

  • Xiaoyu Wang,
  • Wang Zhao,
  • Yongzhong Wang,
  • Qin Zhao and ,
  • Xuejie Yang,
  • Kaixiang Su and
  • Dongxiao Gu
  • + 2 authors+ 0 author

16 January 2020

In order to explore the knowledge base, research hotspot, development status, and future research direction of healthcare research based on information theory and complex science, a total of 3031 literature data samples from the core collection of We...

(This article belongs to the Special Issue Information Theory and Complexity Science Approaches to Health Conditions and Cognitive Decline)
  • Article
  • Open Access
36 Citations
5,985 Views
22 Pages

16 January 2020

The precursory atmospheric gravity wave (AGW) activity in the stratosphere has been investigated in our previous paper by studying an inland Kumamoto earthquake (EQ). We are interested in whether the same phenomenon occurs or not before another major...

(This article belongs to the Special Issue Entropy, Nonlinear Dynamics, and Methods of Complex Systems in Earthquake Physics including Precursory Phenomena II)
  • Article
  • Open Access
3 Citations
5,459 Views
29 Pages

Quantifying Athermality and Quantum Induced Deviations from Classical Fluctuation Relations

  • Zoë Holmes,
  • Erick Hinds Mingo,
  • Calvin Y.-R. Chen and
  • Florian Mintert

16 January 2020

In recent years, a quantum information theoretic framework has emerged for incorporating non-classical phenomena into fluctuation relations. Here, we elucidate this framework by exploring deviations from classical fluctuation relations resulting from...

(This article belongs to the Special Issue Fluctuation Relations and Nonequilibrium Thermodynamics in Classical and Quantum Systems)
  • Article
  • Open Access
20 Citations
6,748 Views
28 Pages

Fast and Efficient Image Encryption Algorithm Based on Modular Addition and SPD

  • Khushbu Khalid Butt,
  • Guohui Li,
  • Sajid Khan and
  • Sohaib Manzoor

16 January 2020

Bit-level and pixel-level methods are two classifications for image encryption, which describe the smallest processing elements manipulated in diffusion and permutation respectively. Most pixel-level permutation methods merely alter the positions of...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
3 Citations
3,663 Views
12 Pages

On the Composability of Statistically Secure Random Oblivious Transfer

  • Rafael Dowsley,
  • Jörn Müller-Quade and
  • Anderson C. A. Nascimento

16 January 2020

We show that random oblivious transfer protocols that are statistically secure according to a definition based on a list of information-theoretical properties are also statistically universally composable. That is, they are simulatable secure with an...

  • Article
  • Open Access
5 Citations
6,673 Views
7 Pages

15 January 2020

This paper is a step towards developing a geometric understanding of a popular algorithm for training deep neural networks named stochastic gradient descent (SGD). We built upon a recent result which observed that the noise in SGD while training typi...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Review
  • Open Access
24 Citations
8,354 Views
20 Pages

14 January 2020

The fundamental information theory functions of entropy, relative entropy, and mutual information are directly applicable to clinical diagnostic testing. This is a consequence of the fact that an individual’s disease state and diagnostic test r...

(This article belongs to the Special Issue Applications of Information Theory to Epidemiology)
  • Article
  • Open Access
34 Citations
6,777 Views
27 Pages

The Convex Information Bottleneck Lagrangian

  • Borja Rodríguez Gálvez,
  • Ragnar Thobaben and
  • Mikael Skoglund

14 January 2020

The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations T of some random variable X for the task of predicting Y. It is defined as a constrained optimization problem that maximizes the information th...

(This article belongs to the Special Issue Information Bottleneck: Theory and Applications in Deep Learning)
  • Article
  • Open Access
5 Citations
3,311 Views
17 Pages

Probabilistic Ensemble of Deep Information Networks

  • Giulio Franzese and
  • Monica Visintin

14 January 2020

We describe a classifier made of an ensemble of decision trees, designed using information theory concepts. In contrast to algorithms C4.5 or ID3, the tree is built from the leaves instead of the root. Each tree is made of nodes trained independently...

(This article belongs to the Special Issue Information Bottleneck: Theory and Applications in Deep Learning)
  • Article
  • Open Access
39 Citations
10,402 Views
13 Pages

14 January 2020

This paper studies the fluid flow and heat transfer characteristics of nanofluids as advance coolants for the cooling system of electric motors. Investigations are carried out using numerical analysis for a cooling system with spiral channels. To sol...

(This article belongs to the Special Issue Selected Papers from the XII International Conference on Computational Heat, Mass and Momentum Transfer (ICCHMT2019))
  • Article
  • Open Access
125 Citations
16,543 Views
16 Pages

A Blockchain-Driven Supply Chain Finance Application for Auto Retail Industry

  • Jingjing Chen,
  • Tiefeng Cai,
  • Wenxiu He,
  • Lei Chen and ,
  • Gang Zhao,
  • Weiwen Zou and
  • Lingling Guo
  • + 2 authors+ 0 author

13 January 2020

In this paper, a Blockchain-driven platform for supply chain finance, BCautoSCF (Zhi-lian-che-rong in Chinese), is introduced. It is successfully established as a reliable and efficient financing platform for the auto retail industry. Due to the Bloc...

(This article belongs to the Special Issue Blockchain: Security, Challenges, and Opportunities)
  • Article
  • Open Access
76 Citations
10,617 Views
16 Pages

13 January 2020

Decoding motor imagery (MI) electroencephalogram (EEG) signals for brain-computer interfaces (BCIs) is a challenging task because of the severe non-stationarity of perceptual decision processes. Recently, deep learning techniques have had great succe...

(This article belongs to the Section Signal and Data Analysis)
  • Article
  • Open Access
9 Citations
4,170 Views
33 Pages

12 January 2020

A distribution that maximizes an entropy can be found by applying two different principles. On the one hand, Jaynes (1957a,b) formulated the maximum entropy principle (MaxEnt) as the search for a distribution maximizing a given entropy under some giv...

  • Article
  • Open Access
3 Citations
6,139 Views
12 Pages

On Unitary t-Designs from Relaxed Seeds

  • Rawad Mezher,
  • Joe Ghalbouni,
  • Joseph Dgheim and
  • Damian Markham

12 January 2020

The capacity to randomly pick a unitary across the whole unitary group is a powerful tool across physics and quantum information. A unitary t-design is designed to tackle this challenge in an efficient way, yet constructions to date rely on heavy con...

(This article belongs to the Section Quantum Information)
  • Article
  • Open Access
23 Citations
4,609 Views
13 Pages

Spectrum Sensing Method Based on Information Geometry and Deep Neural Network

  • Kaixuan Du,
  • Pin Wan,
  • Yonghua Wang,
  • Xiongzhi Ai and
  • Huang Chen

12 January 2020

Due to the scarcity of radio spectrum resources and the growing demand, the use of spectrum sensing technology to improve the utilization of spectrum resources has become a hot research topic. In order to improve the utilization of spectrum resources...

  • Article
  • Open Access
14 Citations
4,799 Views
23 Pages

11 January 2020

Does systematic covariation in the usage patterns of forms shape the sublexical variance observed in conversational speech? We address this question in terms of a recently proposed discriminative theory of human communication that argues that the dis...

(This article belongs to the Special Issue Information Theory and Language)
  • Article
  • Open Access
2 Citations
3,434 Views
11 Pages

10 January 2020

We explore the geometric phase in a system of two non-interacting qubits embedded in two separated open cavities linked via an optical fiber and leaking photons to the external environment. The dynamical behavior of the generated geometric phase is i...

(This article belongs to the Special Issue Quantum Dynamics with Non-Hermitian Hamiltonians)
  • Article
  • Open Access
6 Citations
3,585 Views
18 Pages

Numerical Study of Nanofluid Irreversibilities in a Heat Exchanger Used with an Aqueous Medium

  • Guillermo Efren Ovando-Chacon,
  • Sandy Luz Ovando-Chacon,
  • Abelardo Rodriguez-Leon,
  • Mario Diaz-Gonzalez and ,
  • Jorge Arturo Hernandez-Zarate and
  • Alberto Servin-Martinez
  • + 1 author+ 0 author

10 January 2020

Heat exchangers play an important role in different industrial processes; therefore, it is important to characterize these devices to improve their efficiency by guaranteeing the efficient use of energy. In this study, we carry out a numerical analys...

  • Article
  • Open Access
10 Citations
3,498 Views
17 Pages

10 January 2020

The evaluation of bed shear stress distribution is fundamental to predicting the transport of sediments and pollutants in rivers and to designing successful stable open channels. Such distribution cannot be determined easily as it depends on the velo...

  • Article
  • Open Access
13 Citations
4,063 Views
21 Pages

Single Real Goal, Magnitude-Based Deceptive Path-Planning

  • Kai Xu,
  • Yunxiu Zeng,
  • Long Qin and
  • Quanjun Yin

10 January 2020

Deceptive path-planning is the task of finding a path so as to minimize the probability of an observer (or a defender) identifying the observed agent’s final goal before the goal has been reached. It is one of the important approaches to solvin...

  • Article
  • Open Access
30 Citations
11,880 Views
18 Pages

Time Series Complexities and Their Relationship to Forecasting Performance

  • Mirna Ponce-Flores,
  • Juan Frausto-Solís,
  • Guillermo Santamaría-Bonfil,
  • Joaquín Pérez-Ortega and
  • Juan J. González-Barbosa

10 January 2020

Entropy is a key concept in the characterization of uncertainty for any given signal, and its extensions such as Spectral Entropy and Permutation Entropy. They have been used to measure the complexity of time series. However, these measures are subje...

(This article belongs to the Special Issue Entropy Application for Forecasting)
  • Article
  • Open Access
19 Citations
6,246 Views
13 Pages

Detection of Hypoglycemia Using Measures of EEG Complexity in Type 1 Diabetes Patients

  • Maria Rubega,
  • Fabio Scarpa,
  • Debora Teodori,
  • Anne-Sophie Sejling and ,
  • Christian S. Frandsen and
  • Giovanni Sparacino
  • + 1 author+ 0 author

9 January 2020

Previous literature has demonstrated that hypoglycemic events in patients with type 1 diabetes (T1D) are associated with measurable scalp electroencephalography (EEG) changes in power spectral density. In the present study, we used a dataset of 19-ch...

(This article belongs to the Special Issue Entropy, Nonlinear Dynamics and Complexity)
  • Review
  • Open Access
45 Citations
11,088 Views
16 Pages

High-Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

  • Alexander N. Gorban,
  • Valery A. Makarov and
  • Ivan Y. Tyukin

9 January 2020

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the “curse of dimensionality” states:...

(This article belongs to the Special Issue Entropies: Between Information Geometry and Kinetics)
  • Article
  • Open Access
11 Citations
4,171 Views
20 Pages

9 January 2020

Non-Hermitian quantum-Hamiltonian-candidate combination H λ of a non-Hermitian unperturbed operator H = H 0 with an arbitrary “small” non-Hermitian perturbation λ W is given a mathematically consist...

(This article belongs to the Special Issue Quantum Dynamics with Non-Hermitian Hamiltonians)
  • Article
  • Open Access
5 Citations
3,244 Views
10 Pages

9 January 2020

We supply corrected proofs of the invariance of completion and the chain rule for the Shannon information measures of arbitrary fields, as stated by Dębowski in 2009. Our corrected proofs rest on a number of auxiliary approximation results for Shanno...

(This article belongs to the Special Issue Information Theory and Language)
  • Article
  • Open Access
26 Citations
5,619 Views
22 Pages

The Decomposition and Forecasting of Mutual Investment Funds Using Singular Spectrum Analysis

  • Paulo Canas Rodrigues,
  • Jonatha Pimentel,
  • Patrick Messala and
  • Mohammad Kazemi

9 January 2020

Singular spectrum analysis (SSA) is a non-parametric method that breaks down a time series into a set of components that can be interpreted and grouped as trend, periodicity, and noise, emphasizing the separability of the underlying components and se...

(This article belongs to the Special Issue Data Science: Measuring Uncertainties)
  • Article
  • Open Access
1 Citations
4,593 Views
17 Pages

Numerical Convergence Analysis of the Frank–Kamenetskii Equation

  • Matthew Woolway,
  • Byron A. Jacobs,
  • Ebrahim Momoniat,
  • Charis Harley and
  • Dieter Britz

9 January 2020

This work investigates the convergence dynamics of a numerical scheme employed for the approximation and solution of the Frank–Kamenetskii partial differential equation. A framework for computing the critical Frank–Kamenetskii parameter t...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
2 Citations
2,720 Views
39 Pages

8 January 2020

In this paper, we obtain upper bounds on the minimum distance for turbo codes using fourth degree permutation polynomial (4-PP) interleavers of a specific interleaver length and classical turbo codes of nominal 1/3 coding rate, with two recursive sys...

(This article belongs to the Section Information Theory, Probability and Statistics)

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300