Skip to Content

Entropy, Volume 23, Issue 7

2021 July - 137 articles

Cover Story: The geometric properties of a continuous probability distribution give rise to a statistical manifold via the Fisher information metric and Riemannian geometry. Establishing a coordinate transformation that locally relates the manifold to the Euclidean space results in a coordinate system in which the distribution takes a particularly simple form. This enables an accurate variational approximation of the transformed distribution with a normal distribution, which is provided by the novel geometric Variational Inference (geoVI) algorithm. A computationally efficient implementation of the transformation equips geoVI with a high level of accuracy and an almost linear scaling with the problem size. This enables geoVI to solve non-linear, hierarchical Bayesian inverse problems in very high dimensions. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (137)

  • Article
  • Open Access
4 Citations
4,292 Views
35 Pages

8 July 2021

During the physical foundation of his radiation formula in his December 1900 talk and subsequent 1901 article, Planck refers to Boltzmann’s 1877 combinatorial-probabilistic treatment and obtains his quantum distribution function, while Boltzmann did...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
2 Citations
3,305 Views
15 Pages

8 July 2021

Two types of bifurcation diagrams of cytosolic calcium nonlinear oscillatory systems are presented in rectangular areas determined by two slowly varying parameters. Verification of the periodic dynamics in the two-parameter areas requires solving the...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
9 Citations
5,356 Views
16 Pages

Improved Aerodynamics of a Hollow-Blade Axial Flow Fan by Controlling the Leakage Flow Rate by Air Injection at the Rotating Shroud

  • Michaël Pereira,
  • Florent Ravelet,
  • Kamel Azzouz,
  • Tarik Azzam and ,
  • Hamid Oualli,
  • Smaïne Kouidri and
  • Farid Bakir
  • + 2 authors+ 0 author

8 July 2021

Axial flow fans are used in many fields in order to ensure the mass and heat transfer from air, chiefly in the heating, ventilation and air conditioning industry (HVAC). A more proper understanding of the airflow behavior through the systems is neces...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
2 Citations
3,300 Views
21 Pages

An Improved Stereo Matching Algorithm for Vehicle Speed Measurement System Based on Spatial and Temporal Image Fusion

  • Lei Yang,
  • Qingyuan Li,
  • Xiaowei Song,
  • Wenjing Cai and ,
  • Chunping Hou and
  • Zixiang Xiong
  • + 1 author+ 0 author

7 July 2021

This paper proposes an improved stereo matching algorithm for vehicle speed measurement system based on spatial and temporal image fusion (STIF). Firstly, the matching point pairs in the license plate area with obviously abnormal distance to the came...

(This article belongs to the Special Issue Advances in Image Fusion)
  • Article
  • Open Access
9 Citations
3,984 Views
25 Pages

7 July 2021

The way that progenitor cell fate decisions and the associated environmental sensing are regulated to ensure the robustness of the spatial and temporal order in which cells are generated towards a fully differentiating tissue still remains elusive. H...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
6 Citations
3,105 Views
10 Pages

7 July 2021

The time-dependent quantum Monte Carlo method for fermions is introduced and applied in the calculation of the entanglement of electrons in one-dimensional quantum dots with several spin-polarized and spin-compensated electron configurations. The ric...

  • Article
  • Open Access
9 Citations
6,141 Views
27 Pages

Qualitative Data Clustering to Detect Outliers

  • Agnieszka Nowak-Brzezińska and
  • Weronika Łazarz

7 July 2021

Detecting outliers is a widely studied problem in many disciplines, including statistics, data mining, and machine learning. All anomaly detection activities are aimed at identifying cases of unusual behavior compared to most observations. There are...

  • Article
  • Open Access
18 Citations
3,440 Views
17 Pages

QKD Based on Symmetric Entangled Bernstein-Vazirani

  • Michael Ampatzis and
  • Theodore Andronikos

7 July 2021

This paper introduces a novel entanglement-based QKD protocol, that makes use of a modified symmetric version of the Bernstein-Vazirani algorithm, in order to achieve secure and efficient key distribution. Two variants of the protocol, one fully symm...

(This article belongs to the Special Issue Physical-Layer Security, Quantum Key Distribution and Post-quantum Cryptography)
  • Article
  • Open Access
3 Citations
3,342 Views
19 Pages

DLSTM-Based Successive Cancellation Flipping Decoder for Short Polar Codes

  • Jianming Cui,
  • Wenxiu Kong,
  • Xiaojun Zhang,
  • Da Chen and
  • Qingtian Zeng

6 July 2021

Polar code has been adopted as the control channel coding scheme for the fifth generation (5G), and the performance of short polar codes is receiving intensive attention. The successive cancellation flipping (SC flipping) algorithm suffers a signific...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
19 Citations
4,126 Views
16 Pages

6 July 2021

This study investigates a critical hazard identification method for railway accident prevention. A new accident causation network is proposed to model the interaction between hazards and accidents. To realize consistency between the most likely and s...

(This article belongs to the Special Issue Complex Dynamic System Modelling, Identification and Control)
  • Article
  • Open Access
4 Citations
4,769 Views
27 Pages

5 July 2021

Despite the remarkable success of Carnot’s heat engine cycle in founding the discipline of thermodynamics two centuries ago, false viewpoints of his use of the caloric theory in the cycle linger, limiting his legacy. An action revision of the Carnot...

(This article belongs to the Special Issue Entropy: The Scientific Tool of the 21st Century)
  • Article
  • Open Access
8 Citations
3,647 Views
13 Pages

5 July 2021

This paper shows use of starch-based carbon (CSC) and graphene as the anode electrode for lithium-ion cell. To describe electrochemical stability of the half-cell system and kinetic parameters of charging process in different temperatures, electroche...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
17 Citations
5,514 Views
24 Pages

4 July 2021

We are living in the age of big data, a majority of which is stream data. The real-time processing of this data requires careful consideration from different perspectives. Concept drift is a change in the data’s underlying distribution, a significant...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
16 Citations
5,016 Views
16 Pages

3 July 2021

The environmental control system (ECS) is one of the most important systems in the aircraft used to regulate the pressure, temperature and humidity of the air in the cabin. This study investigates the influences of different architectures on the ther...

(This article belongs to the Collection Feature Papers in Information Theory)
  • Article
  • Open Access
20 Citations
3,956 Views
17 Pages

An Information-Theoretic Perspective on Proper Quaternion Variational Autoencoders

  • Eleonora Grassucci,
  • Danilo Comminiello and
  • Aurelio Uncini

3 July 2021

Variational autoencoders are deep generative models that have recently received a great deal of attention due to their ability to model the latent distribution of any kind of input such as images and audio signals, among others. A novel variational a...

(This article belongs to the Special Issue Adaptive Signal Processing and Machine Learning Using Entropy and Information Theory)
  • Article
  • Open Access
6 Citations
3,827 Views
14 Pages

3 July 2021

One of the most rapidly advancing areas of deep learning research aims at creating models that learn to disentangle the latent factors of variation from a data distribution. However, modeling joint probability mass functions is usually prohibitive, w...

(This article belongs to the Special Issue Representation Learning: Theory, Applications and Ethical Issues)
  • Article
  • Open Access
4 Citations
4,268 Views
7 Pages

3 July 2021

In this paper, we present a derivation of the black hole area entropy with the relationship between entropy and information. The curved space of a black hole allows objects to be imaged in the same way as camera lenses. The maximal information that a...

(This article belongs to the Section Astrophysics, Cosmology, and Black Holes)
  • Article
  • Open Access
1 Citations
2,851 Views
12 Pages

2 July 2021

One of the tasks of data science is the decomposition of large matrices in order to understand their structures. A special case of this is when we decompose relations, i.e., logical matrices. In this paper, we present a method based on the similarity...

(This article belongs to the Special Issue Rough Set Theory and Entropy in Information Science)
  • Article
  • Open Access
56 Citations
7,241 Views
42 Pages

Geometric Variational Inference

  • Philipp Frank,
  • Reimar Leike and
  • Torsten A. Enßlin

2 July 2021

Efficiently accessing the information contained in non-linear and high dimensional probability distributions remains a core challenge in modern statistics. Traditionally, estimators that go beyond point estimates are either categorized as Variational...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
27 Citations
4,586 Views
21 Pages

2 July 2021

Software estimation involves meeting a huge number of different requirements, such as resource allocation, cost estimation, effort estimation, time estimation, and the changing demands of software product customers. Numerous estimation models try to...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
3 Citations
3,088 Views
17 Pages

Seeded Ising Model and Distributed Biometric Template Storage and Matching

  • Hyeong In Choi,
  • Sungjin Lee,
  • Hwan Pyo Moon,
  • Nam-Sook Wee and ,
  • Daehoon Kim and
  • Song-Hwa Kwon
  • + 1 author+ 0 author

1 July 2021

It is known that a variant of Ising model, called Seeded Ising Model, can be used to recover the information content of a biometric template from a fraction of information therein. The method consists in reconstructing the whole template, which is ca...

(This article belongs to the Special Issue Ising Model: Recent Developments and Exotic Applications)
  • Article
  • Open Access
2 Citations
4,297 Views
12 Pages

A Proposal of a Motion Measurement System to Support Visually Impaired People in Rehabilitation Using Low-Cost Inertial Sensors

  • Karla Miriam Reyes Leiva,
  • Milagros Jaén-Vargas,
  • Miguel Ángel Cuba,
  • Sergio Sánchez Lara and
  • José Javier Serrano Olmedo

1 July 2021

The rehabilitation of a visually impaired person (VIP) is a systematic process where the person is provided with tools that allow them to deal with the impairment to achieve personal autonomy and independence, such as training for the use of the long...

(This article belongs to the Special Issue Sensor Data Analytics: Challenges and Methods for Data-Intensive Applications)
  • Article
  • Open Access
9 Citations
5,140 Views
29 Pages

Benchmarking Analysis of the Accuracy of Classification Methods Related to Entropy

  • Yolanda Orenes,
  • Alejandro Rabasa,
  • Jesus Javier Rodriguez-Sala and
  • Joaquin Sanchez-Soriano

1 July 2021

In the machine learning literature we can find numerous methods to solve classification problems. We propose two new performance measures to analyze such methods. These measures are defined by using the concept of proportional reduction of classifica...

(This article belongs to the Special Issue Information Theory in Machine Learning and Data Science II)
  • Article
  • Open Access
2 Citations
2,762 Views
9 Pages

1 July 2021

In the present paper we give conditions under which there exists a unique weak solution for a nonlocal equation driven by the integrodifferential operator of fractional Laplacian type. We argue for the optimality of some assumptions. Some Lyapunov-ty...

(This article belongs to the Special Issue Nonlinear Dynamics and Analysis)
  • Article
  • Open Access
9 Citations
2,779 Views
14 Pages

30 June 2021

We study the dynamical invariant for dissipative three coupled oscillators mainly from the quantum mechanical point of view. It is known that there are many advantages of the invariant quantity in elucidating mechanical properties of the system. We u...

(This article belongs to the Special Issue Dynamical Systems, Differential Equations and Applications)
  • Article
  • Open Access
4 Citations
3,040 Views
19 Pages

Solutions of the Multivariate Inverse Frobenius–Perron Problem

  • Colin Fox,
  • Li-Jen Hsiao and
  • Jeong-Eun (Kate) Lee

30 June 2021

We address the inverse Frobenius–Perron problem: given a prescribed target distribution ρ, find a deterministic map M such that iterations of M tend to ρ in distribution. We show that all solutions may be written in terms of a factorization that comb...

(This article belongs to the Special Issue Dynamical Systems, Differential Equations and Applications)
  • Article
  • Open Access
16 Citations
5,672 Views
12 Pages

Increased Entropic Brain Dynamics during DeepDream-Induced Altered Perceptual Phenomenology

  • Antonino Greco,
  • Giuseppe Gallitto,
  • Marco D’Alessandro and
  • Clara Rastelli

30 June 2021

In recent years, the use of psychedelic drugs to study brain dynamics has flourished due to the unique opportunity they offer to investigate the neural mechanisms of conscious perception. Unfortunately, there are many difficulties to conduct experime...

(This article belongs to the Special Issue Information Theory in Deep Learning and Signal Processing for Biomedical Signal Analysis)
  • Feature Paper
  • Article
  • Open Access
55 Citations
6,040 Views
21 Pages

List Decoding of Arıkan’s PAC Codes

  • Hanwen Yao,
  • Arman Fazeli and
  • Alexander Vardy

30 June 2021

Polar coding gives rise to the first explicit family of codes that provably achieve capacity with efficient encoding and decoding for a wide range of channels. However, its performance at short blocklengths under standard successive cancellation deco...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
4 Citations
3,474 Views
13 Pages

Wealth Rheology

  • Zdzislaw Burda,
  • Malgorzata J. Krawczyk,
  • Krzysztof Malarz and
  • Malgorzata Snarska

30 June 2021

We study wealth rank correlations in a simple model of macroeconomy. To quantify rank correlations between wealth rankings at different times, we use Kendall’s τ and Spearman’s ρ, Goodman–Kruskal’s γ, and the lists’ overlap ratio. We show that the dy...

(This article belongs to the Special Issue Entropy and Social Physics)
  • Article
  • Open Access
13 Citations
6,558 Views
19 Pages

30 June 2021

The aim of this article is to provide an evolutionarily grounded explanation of central aspects of the structure of language. It begins with an account of the evolution of human causal reasoning. A comparison between humans and non-human primates sug...

(This article belongs to the Special Issue Complexity and Evolution)
  • Article
  • Open Access
21 Citations
4,247 Views
29 Pages

Clifford Wavelet Entropy for Fetal ECG Extraction

  • Malika Jallouli,
  • Sabrine Arfaoui,
  • Anouar Ben Mabrouk and
  • Carlo Cattani

30 June 2021

Analysis of the fetal heart rate during pregnancy is essential for monitoring the proper development of the fetus. Current fetal heart monitoring techniques lack the accuracy in fetal heart rate monitoring and features acquisition, resulting in diagn...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
1 Citations
2,947 Views
13 Pages

30 June 2021

A cornerstone in the modeling of wireless communication is MIMO systems, where a complex matrix variate normal assumption is often made for the underlying distribution of the propagation matrix. A popular measure of information, namely capacity, is o...

(This article belongs to the Special Issue Measures of Information)
  • Article
  • Open Access
3 Citations
3,656 Views
11 Pages

30 June 2021

Modifications to the traditional Onsager theory for modeling isotropic–nematic phase transitions in hard prolate spheroidal systems are presented. Pure component systems are used to identify the need to update the Lee–Parsons resummation term. The Le...

  • Article
  • Open Access
11 Citations
8,038 Views
16 Pages

30 June 2021

Pulseless electrical activity (PEA) is characterized by the disassociation of the mechanical and electrical activity of the heart and appears as the initial rhythm in 20–30% of out-of-hospital cardiac arrest (OHCA) cases. Predicting whether a patient...

(This article belongs to the Special Issue Selected Papers from 38th Annual Conference of Spanish Society of Biomedical Engineering)
  • Article
  • Open Access
2 Citations
3,467 Views
13 Pages

30 June 2021

The Hurwitz complex continued fraction is a generalization of the nearest integer continued fraction. In this paper, we prove various results concerning extremes of the modulus of Hurwitz complex continued fraction digits. This includes a Poisson law...

(This article belongs to the Special Issue Extreme Value Theory)
  • Article
  • Open Access
57 Citations
3,875 Views
21 Pages

Some New Hermite–Hadamard and Related Inequalities for Convex Functions via (p,q)-Integral

  • Miguel Vivas-Cortez,
  • Muhammad Aamir Ali,
  • Hüseyin Budak,
  • Humaira Kalsoom and
  • Praveen Agarwal

29 June 2021

In this investigation, for convex functions, some new (p,q)–Hermite–Hadamard-type inequalities using the notions of (p,q)π2 derivative and (p,q)π2 integral are obtained. Furthermore, for (p,q)π2-differentiable convex functions, some new (p,q) estimat...

(This article belongs to the Special Issue Advanced Numerical Methods for Differential Equations)
  • Article
  • Open Access
27 Citations
5,180 Views
22 Pages

29 June 2021

This study proposes a method for identifying and evaluating driving risk as a first step towards calculating premiums in the newly emerging context of usage-based insurance. Telematics data gathered by the Internet of Vehicles (IoV) contain a large n...

(This article belongs to the Special Issue Sensor Data Analytics: Challenges and Methods for Data-Intensive Applications)
  • Article
  • Open Access
32 Citations
14,470 Views
27 Pages

An Active Inference Model of Collective Intelligence

  • Rafael Kaufmann,
  • Pranav Gupta and
  • Jacob Taylor

29 June 2021

Collective intelligence, an emergent phenomenon in which a composite system of multiple interacting agents performs at levels greater than the sum of its parts, has long compelled research efforts in social and behavioral sciences. To date, however,...

(This article belongs to the Special Issue Applying the Free-Energy Principle to Complex Adaptive Systems)
  • Editorial
  • Open Access
3 Citations
3,814 Views
5 Pages

29 June 2021

Due to the proliferation of applications and services that run over communication networks, ranging from video streaming and data analytics to robotics and augmented reality, tomorrow’s networks will be faced with increasing challenges resulting from...

(This article belongs to the Special Issue Machine Learning for Communications)
  • Article
  • Open Access
45 Citations
5,557 Views
17 Pages

29 June 2021

This paper analyses the complexity of electroencephalogram (EEG) signals in different temporal scales for the analysis and classification of focal and non-focal EEG signals. Futures from an original multiscale permutation Lempel–Ziv complexity measur...

(This article belongs to the Special Issue Information Theory in Biomedical Data Mining)
  • Article
  • Open Access
3 Citations
2,440 Views
18 Pages

An Objective Prior from a Scoring Rule

  • Stephen G. Walker and
  • Cristiano Villa

29 June 2021

In this paper, we introduce a novel objective prior distribution levering on the connections between information, divergence and scoring rules. In particular, we do so from the starting point of convex functions representing information in density fu...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
7 Citations
3,090 Views
14 Pages

29 June 2021

Internal gear mechanism is widely used in micro-nano satellites due to its compact structure and high precision transmission. However, the vibration coupling caused by the small clearance coupling is more obvious and cannot be ignored under low speed...

  • Article
  • Open Access
4 Citations
2,846 Views
15 Pages

Algorithmic Information Distortions in Node-Aligned and Node-Unaligned Multidimensional Networks

  • Felipe S. Abrahão,
  • Klaus Wehmuth,
  • Hector Zenil and
  • Artur Ziviani

29 June 2021

In this article, we investigate limitations of importing methods based on algorithmic information theory from monoplex networks into multidimensional networks (such as multilayer networks) that have a large number of extra dimensions (i.e., aspects)....

(This article belongs to the Special Issue Selected Papers from the Ninth International Conference on Complex Networks and Their Applications)
  • Article
  • Open Access
10 Citations
4,023 Views
13 Pages

29 June 2021

In our previous work, by combining the Hilbert scan with the symbol grouping method, efficient run-length-based entropy coding was developed, and high-efficiency image compression algorithms based on the entropy coding were obtained. However, the 2-D...

(This article belongs to the Special Issue Entropy in Image Analysis III)
  • Article
  • Open Access
11 Citations
3,575 Views
14 Pages

28 June 2021

The multi-agent information fusion (MAIF) system can alleviate the limitations of a single expert system in dealing with complex situations, as it allows multiple agents to cooperate in order to solve problems in complex environments. Dempster–Shafer...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
2 Citations
3,920 Views
20 Pages

28 June 2021

We investigated the spatial phase separation of the two components forming a bosonic mixture distributed in a four-well lattice with a ring geometry. We studied the ground state of this system, described by means of a binary Bose–Hubbard Hamiltonian,...

(This article belongs to the Section Statistical Physics)
  • Article
  • Open Access
14 Citations
4,695 Views
22 Pages

28 June 2021

Imbalance ensemble classification is one of the most essential and practical strategies for improving decision performance in data analysis. There is a growing body of literature about ensemble techniques for imbalance learning in recent years, the v...

  • Article
  • Open Access
16 Citations
4,259 Views
19 Pages

Discrimination of Patients with Varying Degrees of Coronary Artery Stenosis by ECG and PCG Signals Based on Entropy

  • Huan Zhang,
  • Xinpei Wang,
  • Changchun Liu,
  • Yuanyang Li and ,
  • Yuanyuan Liu,
  • Yu Jiao,
  • Tongtong Liu,
  • Huiwen Dong and
  • Jikuo Wang
  • + 4 authors+ 0 author

28 June 2021

Coronary heart disease (CHD) is the leading cause of cardiovascular death. This study aimed to propose an effective method for mining cardiac mechano-electric coupling information and to evaluate its ability to distinguish patients with varying degre...

(This article belongs to the Special Issue Entropy in Data Analysis)

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300