Skip to Content

Entropy, Volume 22, Issue 1

2020 January - 127 articles

Cover Story: Optimal lossy data compression minimizes the storage cost of a data set X while retaining a given amount of information as possible about something (Y) that you care about. For example, what aspects of an image X contain the most information about whether it depicts a cat or not?
We present a method for efficiently solving this problem and apply it to the CIFAR-10, MNIST, and Fashion-MNIST datasets, illustrating how it can be interpreted as an information-theoretically optimal image clustering algorithm. For merely a handful of clusters, compressing the image into a single integer specifying its cluster number retains almost all the information about its class label Y. View this paper.
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (127)

  • Article
  • Open Access
6 Citations
4,061 Views
19 Pages

20 January 2020

Compressed sensing (CS) offers a framework for image acquisition, which has excellent potential in image sampling and compression applications due to the sub-Nyquist sampling rate and low complexity. In engineering practices, the resulting CS samples...

  • Article
  • Open Access
7 Citations
4,767 Views
13 Pages

Eigenvalues of Two-State Quantum Walks Induced by the Hadamard Walk

  • Shimpei Endo,
  • Takako Endo,
  • Takashi Komatsu and
  • Norio Konno

20 January 2020

Existence of the eigenvalues of the discrete-time quantum walks is deeply related to localization of the walks. We revealed, for the first time, the distributions of the eigenvalues given by the splitted generating function method (the SGF method) of...

  • Article
  • Open Access
72 Citations
12,517 Views
14 Pages

20 January 2020

The use of Project Gutenberg (PG) as a text corpus has been extremely popular in statistical analysis of language for more than 25 years. However, in contrast to other major linguistic datasets of similar importance, no consensual full version of PG...

  • Article
  • Open Access
11 Citations
4,051 Views
12 Pages

19 January 2020

We study the q-voter model with flexibility, which allows for describing a broad spectrum of independence from zealots, inflexibility, or stubbornness through noisy voters to self-anticonformity. Analyzing the model within the pair approximation allo...

  • Article
  • Open Access
4 Citations
5,316 Views
27 Pages

19 January 2020

This paper studies the problem of tangible assets acquisition within the company by proposing a new hybrid model that uses linear programming and fuzzy numbers. Regarding linear programming, two methods were implemented in the model, namely: the grap...

  • Article
  • Open Access
25 Citations
4,158 Views
15 Pages

19 January 2020

In this study, the design of an adaptive terminal sliding mode controller for the stabilization of port Hamiltonian chaotic systems with hidden attractors is proposed. This study begins with the design methodology of a chaotic oscillator with a hidde...

  • Article
  • Open Access
14 Citations
4,251 Views
12 Pages

Analyzing Uncertainty in Complex Socio-Ecological Networks

  • Ana D. Maldonado,
  • María Morales,
  • Pedro A. Aguilera and
  • Antonio Salmerón

19 January 2020

Socio-ecological systems are recognized as complex adaptive systems whose multiple interactions might change as a response to external or internal changes. Due to its complexity, the behavior of the system is often uncertain. Bayesian networks provid...

  • Article
  • Open Access
14 Citations
5,103 Views
17 Pages

Association between Mean Heart Rate and Recurrence Quantification Analysis of Heart Rate Variability in End-Stage Renal Disease

  • Martín Calderón-Juárez,
  • Gertrudis Hortensia González-Gómez,
  • Juan C. Echeverría,
  • Héctor Pérez-Grovas and
  • Claudia Lerma

18 January 2020

Linear heart rate variability (HRV) indices are dependent on the mean heart rate, which has been demonstrated in different models (from sinoatrial cells to humans). The association between nonlinear HRV indices, including those provided by recurrence...

  • Article
  • Open Access
26 Citations
5,366 Views
20 Pages

Permutation Entropy and Statistical Complexity in Mild Cognitive Impairment and Alzheimer’s Disease: An Analysis Based on Frequency Bands

  • Ignacio Echegoyen,
  • David López-Sanz,
  • Johann H. Martínez,
  • Fernando Maestú and
  • Javier M. Buldú

18 January 2020

We present one of the first applications of Permutation Entropy (PE) and Statistical Complexity (SC) (measured as the product of PE and Jensen-Shanon Divergence) on Magnetoencephalography (MEG) recordings of 46 subjects suffering from Mild Cognitive...

  • Article
  • Open Access
7 Citations
4,959 Views
15 Pages

18 January 2020

Temperature influences the life of many organisms in various ways. A great number of organisms live under conditions where their ability to adapt to changes in temperature can be vital and largely determines their fitness. Understanding the mechanism...

  • Article
  • Open Access
13 Citations
4,382 Views
20 Pages

Activeness and Loyalty Analysis in Event-Based Social Networks

  • Thanh Trinh,
  • Dingming Wu,
  • Joshua Zhexue Huang and
  • Muhammad Azhar

18 January 2020

Event-based social networks (EBSNs) are widely used to create online social groups and organize offline events for users. Activeness and loyalty are crucial characteristics of these online social groups in terms of determining the growth or inactiven...

  • Article
  • Open Access
39 Citations
6,049 Views
22 Pages

Entropy-Based Image Fusion with Joint Sparse Representation and Rolling Guidance Filter

  • Yudan Liu,
  • Xiaomin Yang,
  • Rongzhu Zhang,
  • Marcelo Keese Albertini,
  • Turgay Celik and
  • Gwanggil Jeon

18 January 2020

Image fusion is a very practical technology that can be applied in many fields, such as medicine, remote sensing and surveillance. An image fusion method using multi-scale decomposition and joint sparse representation is introduced in this paper. Fir...

  • Article
  • Open Access
23 Citations
4,297 Views
17 Pages

17 January 2020

Driving safety in tunnels has always been an issue of great concern. Establishing delineators to improve drivers’ instantaneous cognition of the surrounding environment in tunnels can effectively enhance driver safety. Through a simulation stud...

  • Article
  • Open Access
12 Citations
5,625 Views
19 Pages

Energy and Exergy Evaluation of a Two-Stage Axial Vapour Compressor on the LNG Carrier

  • Igor Poljak,
  • Josip Orović,
  • Vedran Mrzljak and
  • Dean Bernečić

17 January 2020

Data from a two-stage axial vapor cryogenic compressor on the dual-fuel diesel–electric (DFDE) liquefied natural gas (LNG) carrier were measured and analyzed to investigate compressor energy and exergy efficiency in real exploitation conditions...

  • Feature Paper
  • Article
  • Open Access
22 Citations
6,204 Views
19 Pages

Learning in Feedforward Neural Networks Accelerated by Transfer Entropy

  • Adrian Moldovan,
  • Angel Caţaron and
  • Răzvan Andonie

16 January 2020

Current neural networks architectures are many times harder to train because of the increasing size and complexity of the used datasets. Our objective is to design more efficient training algorithms utilizing causal relationships inferred from neural...

  • Article
  • Open Access
5 Citations
4,002 Views
12 Pages

Complexity of Cardiotocographic Signals as A Predictor of Labor

  • João Monteiro-Santos,
  • Teresa Henriques,
  • Inês Nunes,
  • Célia Amorim-Costa,
  • João Bernardes and
  • Cristina Costa-Santos

16 January 2020

Prediction of labor is of extreme importance in obstetric care to allow for preventive measures, assuring that both baby and mother have the best possible care. In this work, the authors studied how important nonlinear parameters (entropy and compres...

  • Article
  • Open Access
16 Citations
5,538 Views
14 Pages

Determining the Bulk Parameters of Plasma Electrons from Pitch-Angle Distribution Measurements

  • Georgios Nicolaou,
  • Robert Wicks,
  • George Livadiotis,
  • Daniel Verscharen,
  • Christopher Owen and
  • Dhiren Kataria

16 January 2020

Electrostatic analysers measure the flux of plasma particles in velocity space and determine their velocity distribution function. There are occasions when science objectives require high time-resolution measurements, and the instrument operates in s...

  • Article
  • Open Access
3 Citations
5,942 Views
26 Pages

16 January 2020

Sources that generate symbolic sequences with algorithmic nature may differ in statistical complexity because they create structures that follow algorithmic schemes, rather than generating symbols from a probabilistic function assuming independence....

  • Article
  • Open Access
6 Citations
3,250 Views
15 Pages

Spatio-Temporal Evolution Analysis of Drought Based on Cloud Transformation Algorithm over Northern Anhui Province

  • Xia Bai,
  • Yimin Wang,
  • Juliang Jin,
  • Shaowei Ning,
  • Yanfang Wang and
  • Chengguo Wu

16 January 2020

Drought is one of the most typical and serious natural disasters, which occurs frequently in most of mainland China, and it is crucial to explore the evolution characteristics of drought for developing effective schemes and strategies of drought disa...

  • Article
  • Open Access
7 Citations
3,938 Views
32 Pages

16 January 2020

Information theory provides a mathematical foundation to measure uncertainty in belief. Belief is represented by a probability distribution that captures our understanding of an outcome’s plausibility. Information measures based on Shannon&rsqu...

  • Article
  • Open Access
7 Citations
5,658 Views
15 Pages

Visual Analysis on Information Theory and Science of Complexity Approaches in Healthcare Research

  • Xiaoyu Wang,
  • Wang Zhao,
  • Yongzhong Wang,
  • Qin Zhao,
  • Xuejie Yang,
  • Kaixiang Su and
  • Dongxiao Gu

16 January 2020

In order to explore the knowledge base, research hotspot, development status, and future research direction of healthcare research based on information theory and complex science, a total of 3031 literature data samples from the core collection of We...

  • Article
  • Open Access
35 Citations
5,041 Views
22 Pages

16 January 2020

The precursory atmospheric gravity wave (AGW) activity in the stratosphere has been investigated in our previous paper by studying an inland Kumamoto earthquake (EQ). We are interested in whether the same phenomenon occurs or not before another major...

  • Article
  • Open Access
2 Citations
5,004 Views
29 Pages

Quantifying Athermality and Quantum Induced Deviations from Classical Fluctuation Relations

  • Zoë Holmes,
  • Erick Hinds Mingo,
  • Calvin Y.-R. Chen and
  • Florian Mintert

16 January 2020

In recent years, a quantum information theoretic framework has emerged for incorporating non-classical phenomena into fluctuation relations. Here, we elucidate this framework by exploring deviations from classical fluctuation relations resulting from...

  • Article
  • Open Access
2 Citations
3,353 Views
12 Pages

On the Composability of Statistically Secure Random Oblivious Transfer

  • Rafael Dowsley,
  • Jörn Müller-Quade and
  • Anderson C. A. Nascimento

16 January 2020

We show that random oblivious transfer protocols that are statistically secure according to a definition based on a list of information-theoretical properties are also statistically universally composable. That is, they are simulatable secure with an...

  • Article
  • Open Access
18 Citations
6,017 Views
28 Pages

Fast and Efficient Image Encryption Algorithm Based on Modular Addition and SPD

  • Khushbu Khalid Butt,
  • Guohui Li,
  • Sajid Khan and
  • Sohaib Manzoor

16 January 2020

Bit-level and pixel-level methods are two classifications for image encryption, which describe the smallest processing elements manipulated in diffusion and permutation respectively. Most pixel-level permutation methods merely alter the positions of...

  • Article
  • Open Access
5 Citations
6,235 Views
7 Pages

15 January 2020

This paper is a step towards developing a geometric understanding of a popular algorithm for training deep neural networks named stochastic gradient descent (SGD). We built upon a recent result which observed that the noise in SGD while training typi...

  • Review
  • Open Access
18 Citations
6,874 Views
20 Pages

14 January 2020

The fundamental information theory functions of entropy, relative entropy, and mutual information are directly applicable to clinical diagnostic testing. This is a consequence of the fact that an individual’s disease state and diagnostic test r...

  • Article
  • Open Access
29 Citations
6,116 Views
27 Pages

The Convex Information Bottleneck Lagrangian

  • Borja Rodríguez Gálvez,
  • Ragnar Thobaben and
  • Mikael Skoglund

14 January 2020

The information bottleneck (IB) problem tackles the issue of obtaining relevant compressed representations T of some random variable X for the task of predicting Y. It is defined as a constrained optimization problem that maximizes the information th...

  • Article
  • Open Access
5 Citations
3,129 Views
17 Pages

Probabilistic Ensemble of Deep Information Networks

  • Giulio Franzese and
  • Monica Visintin

14 January 2020

We describe a classifier made of an ensemble of decision trees, designed using information theory concepts. In contrast to algorithms C4.5 or ID3, the tree is built from the leaves instead of the root. Each tree is made of nodes trained independently...

  • Article
  • Open Access
34 Citations
9,211 Views
13 Pages

14 January 2020

This paper studies the fluid flow and heat transfer characteristics of nanofluids as advance coolants for the cooling system of electric motors. Investigations are carried out using numerical analysis for a cooling system with spiral channels. To sol...

  • Article
  • Open Access
65 Citations
9,121 Views
16 Pages

13 January 2020

Decoding motor imagery (MI) electroencephalogram (EEG) signals for brain-computer interfaces (BCIs) is a challenging task because of the severe non-stationarity of perceptual decision processes. Recently, deep learning techniques have had great succe...

  • Article
  • Open Access
120 Citations
15,235 Views
16 Pages

A Blockchain-Driven Supply Chain Finance Application for Auto Retail Industry

  • Jingjing Chen,
  • Tiefeng Cai,
  • Wenxiu He,
  • Lei Chen,
  • Gang Zhao,
  • Weiwen Zou and
  • Lingling Guo

13 January 2020

In this paper, a Blockchain-driven platform for supply chain finance, BCautoSCF (Zhi-lian-che-rong in Chinese), is introduced. It is successfully established as a reliable and efficient financing platform for the auto retail industry. Due to the Bloc...

  • Article
  • Open Access
9 Citations
3,920 Views
33 Pages

12 January 2020

A distribution that maximizes an entropy can be found by applying two different principles. On the one hand, Jaynes (1957a,b) formulated the maximum entropy principle (MaxEnt) as the search for a distribution maximizing a given entropy under some giv...

  • Article
  • Open Access
3 Citations
5,603 Views
12 Pages

On Unitary t-Designs from Relaxed Seeds

  • Rawad Mezher,
  • Joe Ghalbouni,
  • Joseph Dgheim and
  • Damian Markham

12 January 2020

The capacity to randomly pick a unitary across the whole unitary group is a powerful tool across physics and quantum information. A unitary t-design is designed to tackle this challenge in an efficient way, yet constructions to date rely on heavy con...

  • Article
  • Open Access
18 Citations
4,248 Views
13 Pages

Spectrum Sensing Method Based on Information Geometry and Deep Neural Network

  • Kaixuan Du,
  • Pin Wan,
  • Yonghua Wang,
  • Xiongzhi Ai and
  • Huang Chen

12 January 2020

Due to the scarcity of radio spectrum resources and the growing demand, the use of spectrum sensing technology to improve the utilization of spectrum resources has become a hot research topic. In order to improve the utilization of spectrum resources...

  • Article
  • Open Access
13 Citations
4,409 Views
23 Pages

11 January 2020

Does systematic covariation in the usage patterns of forms shape the sublexical variance observed in conversational speech? We address this question in terms of a recently proposed discriminative theory of human communication that argues that the dis...

  • Article
  • Open Access
2 Citations
3,146 Views
11 Pages

10 January 2020

We explore the geometric phase in a system of two non-interacting qubits embedded in two separated open cavities linked via an optical fiber and leaking photons to the external environment. The dynamical behavior of the generated geometric phase is i...

  • Article
  • Open Access
5 Citations
3,259 Views
18 Pages

Numerical Study of Nanofluid Irreversibilities in a Heat Exchanger Used with an Aqueous Medium

  • Guillermo Efren Ovando-Chacon,
  • Sandy Luz Ovando-Chacon,
  • Abelardo Rodriguez-Leon,
  • Mario Diaz-Gonzalez,
  • Jorge Arturo Hernandez-Zarate and
  • Alberto Servin-Martinez

10 January 2020

Heat exchangers play an important role in different industrial processes; therefore, it is important to characterize these devices to improve their efficiency by guaranteeing the efficient use of energy. In this study, we carry out a numerical analys...

  • Article
  • Open Access
10 Citations
3,242 Views
17 Pages

10 January 2020

The evaluation of bed shear stress distribution is fundamental to predicting the transport of sediments and pollutants in rivers and to designing successful stable open channels. Such distribution cannot be determined easily as it depends on the velo...

  • Article
  • Open Access
11 Citations
3,686 Views
21 Pages

Single Real Goal, Magnitude-Based Deceptive Path-Planning

  • Kai Xu,
  • Yunxiu Zeng,
  • Long Qin and
  • Quanjun Yin

10 January 2020

Deceptive path-planning is the task of finding a path so as to minimize the probability of an observer (or a defender) identifying the observed agent’s final goal before the goal has been reached. It is one of the important approaches to solvin...

  • Article
  • Open Access
25 Citations
10,248 Views
18 Pages

Time Series Complexities and Their Relationship to Forecasting Performance

  • Mirna Ponce-Flores,
  • Juan Frausto-Solís,
  • Guillermo Santamaría-Bonfil,
  • Joaquín Pérez-Ortega and
  • Juan J. González-Barbosa

10 January 2020

Entropy is a key concept in the characterization of uncertainty for any given signal, and its extensions such as Spectral Entropy and Permutation Entropy. They have been used to measure the complexity of time series. However, these measures are subje...

  • Article
  • Open Access
15 Citations
5,539 Views
13 Pages

Detection of Hypoglycemia Using Measures of EEG Complexity in Type 1 Diabetes Patients

  • Maria Rubega,
  • Fabio Scarpa,
  • Debora Teodori,
  • Anne-Sophie Sejling,
  • Christian S. Frandsen and
  • Giovanni Sparacino

9 January 2020

Previous literature has demonstrated that hypoglycemic events in patients with type 1 diabetes (T1D) are associated with measurable scalp electroencephalography (EEG) changes in power spectral density. In the present study, we used a dataset of 19-ch...

  • Review
  • Open Access
42 Citations
9,531 Views
16 Pages

High-Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality

  • Alexander N. Gorban,
  • Valery A. Makarov and
  • Ivan Y. Tyukin

9 January 2020

High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the “curse of dimensionality” states:...

  • Article
  • Open Access
9 Citations
3,833 Views
20 Pages

9 January 2020

Non-Hermitian quantum-Hamiltonian-candidate combination H λ of a non-Hermitian unperturbed operator H = H 0 with an arbitrary “small” non-Hermitian perturbation λ W is given a mathematically consist...

  • Article
  • Open Access
23 Citations
5,177 Views
22 Pages

The Decomposition and Forecasting of Mutual Investment Funds Using Singular Spectrum Analysis

  • Paulo Canas Rodrigues,
  • Jonatha Pimentel,
  • Patrick Messala and
  • Mohammad Kazemi

9 January 2020

Singular spectrum analysis (SSA) is a non-parametric method that breaks down a time series into a set of components that can be interpreted and grouped as trend, periodicity, and noise, emphasizing the separability of the underlying components and se...

  • Article
  • Open Access
1 Citations
4,142 Views
17 Pages

Numerical Convergence Analysis of the Frank–Kamenetskii Equation

  • Matthew Woolway,
  • Byron A. Jacobs,
  • Ebrahim Momoniat,
  • Charis Harley and
  • Dieter Britz

9 January 2020

This work investigates the convergence dynamics of a numerical scheme employed for the approximation and solution of the Frank–Kamenetskii partial differential equation. A framework for computing the critical Frank–Kamenetskii parameter t...

  • Article
  • Open Access
2 Citations
2,495 Views
39 Pages

8 January 2020

In this paper, we obtain upper bounds on the minimum distance for turbo codes using fourth degree permutation polynomial (4-PP) interleavers of a specific interleaver length and classical turbo codes of nominal 1/3 coding rate, with two recursive sys...

of 3

Get Alerted

Add your email address to receive forthcoming issues of this journal.

XFacebookLinkedIn
Entropy - ISSN 1099-4300