Skip to Content

Entropy, Volume 24, Issue 3

2022 March - 127 articles

Cover Story: Can mathematical models of the brain improve robotics? We summarise how active inference—a well-known description of brain function and behaviour from neuroscience—can be used to build effective autonomous systems that show state-of-the-art performance in several robotics settings. The key features of active inference could soon provide solutions to current technical challenges in robotics and advance human-centred robotic applications, including context-adaptive, safe and social robots, wearable devices, regulatory processes and neurotechnology. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (127)

  • Feature Paper
  • Article
  • Open Access
3 Citations
3,780 Views
11 Pages

21 March 2022

In this paper, we considered the representation power of local overlapping histograms for discrete binary signals. We give an algorithm that is linear in signal size and factorial in window size for producing the set of signals, which share a sequenc...

(This article belongs to the Special Issue Application of Entropy to Computer Vision and Medical Imaging)
  • Article
  • Open Access
10 Citations
4,430 Views
17 Pages

Task’s Choice: Pruning-Based Feature Sharing (PBFS) for Multi-Task Learning

  • Ying Chen,
  • Jiong Yu,
  • Yutong Zhao,
  • Jiaying Chen and
  • Xusheng Du

21 March 2022

In most of the existing multi-task learning (MTL) models, multiple tasks’ public information is learned by sharing parameters across hidden layers, such as hard sharing, soft sharing, and hierarchical sharing. One promising approach is to intro...

(This article belongs to the Topic Machine and Deep Learning)
  • Article
  • Open Access
3 Citations
3,800 Views
12 Pages

20 March 2022

An enhanced affine projection algorithm (APA) is proposed to improve the filter performance in aspects of convergence rate and steady-state estimation error, since the adjustment of the input-vector number can be an effective way to increase the conv...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Review
  • Open Access
7 Citations
4,571 Views
31 Pages

GDP vs. LDP: A Survey from the Perspective of Information-Theoretic Channel

  • Hai Liu,
  • Changgen Peng,
  • Youliang Tian,
  • Shigong Long and ,
  • Feng Tian and
  • Zhenqiang Wu
  • + 1 author+ 0 author

19 March 2022

The existing work has conducted in-depth research and analysis on global differential privacy (GDP) and local differential privacy (LDP) based on information theory. However, the data privacy preserving community does not systematically review and an...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
2 Citations
3,458 Views
9 Pages

19 March 2022

The Householder transformation, allowing a rewrite of probabilities into expectations of dichotomic observables, is generalized in terms of its spectral decomposition. The dichotomy is modulated by allowing more than one negative eigenvalue or by aba...

(This article belongs to the Special Issue Quantum Probability and Randomness III)
  • Article
  • Open Access
7 Citations
3,991 Views
12 Pages

19 March 2022

The mechanism of cerebral blood flow autoregulation can be of great importance in diagnosing and controlling a diversity of cerebrovascular pathologies such as vascular dementia, brain injury, and neurodegenerative diseases. To assess it, there are s...

(This article belongs to the Topic Complex Systems and Artificial Intelligence)
  • Article
  • Open Access
2 Citations
3,186 Views
11 Pages

19 March 2022

An end-to-end joint source–channel (JSC) encoding matrix and a JSC decoding scheme using the proposed bit flipping check (BFC) algorithm and controversial variable node selection-based adaptive belief propagation (CVNS-ABP) decoding algorithm a...

(This article belongs to the Collection Feature Papers in Information Theory)
  • Article
  • Open Access
13 Citations
4,689 Views
14 Pages

A Soar-Based Space Exploration Algorithm for Mobile Robots

  • Fei Luo,
  • Qin Zhou,
  • Joel Fuentes,
  • Weichao Ding and
  • Chunhua Gu

19 March 2022

Space exploration is a hot topic in the application field of mobile robots. Proposed solutions have included the frontier exploration algorithm, heuristic algorithms, and deep reinforcement learning. However, these methods cannot solve space explorat...

(This article belongs to the Special Issue Artificial Intelligence and Computational Issues in Engineering Applications)
  • Article
  • Open Access
18 Citations
12,170 Views
19 Pages

19 March 2022

Offline hand-drawn diagram recognition is concerned with digitizing diagrams sketched on paper or whiteboard to enable further editing. Some existing models can identify the individual objects like arrows and symbols, but they become involved in the...

(This article belongs to the Topic Machine and Deep Learning)
  • Article
  • Open Access
5 Citations
4,065 Views
12 Pages

Low-Complexity Chase Decoding of Reed–Solomon Codes Using Channel Evaluation

  • Hao Wang,
  • Wei Zhang,
  • Yanyan Chang,
  • Jiajing Gao and
  • Yanyan Liu

18 March 2022

A novel time-varying channel adaptive low-complexity chase (LCC) algorithm with low redundancy is proposed, where only the necessary number of test vectors (TVs) are generated and key equations are calculated according to the channel evaluation to re...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
18 Citations
7,590 Views
25 Pages

Coupled VAE: Improved Accuracy and Robustness of a Variational Autoencoder

  • Shichen Cao,
  • Jingjing Li,
  • Kenric P. Nelson and
  • Mark A. Kon

18 March 2022

We present a coupled variational autoencoder (VAE) method, which improves the accuracy and robustness of the model representation of handwritten numeral images. The improvement is measured in both increasing the likelihood of the reconstructed images...

(This article belongs to the Special Issue Approximate Bayesian Inference)
  • Article
  • Open Access
2 Citations
4,075 Views
13 Pages

Entropy Analysis of Neonatal Electrodermal Activity during the First Three Days after Birth

  • Zuzana Visnovcova,
  • Marek Kozar,
  • Zuzana Kuderava,
  • Mirko Zibolen and ,
  • Nikola Ferencova and
  • Ingrid Tonhajzerova
  • + 1 author+ 0 author

17 March 2022

The entropy-based parameters determined from the electrodermal activity (EDA) biosignal evaluate the complexity within the activity of the sympathetic cholinergic system. We focused on the evaluation of the complex sympathetic cholinergic regulation...

(This article belongs to the Special Issue Entropy in the Application of Biomedical Signals)
  • Feature Paper
  • Article
  • Open Access
19 Citations
7,814 Views
21 Pages

17 March 2022

By calculating the Kullback–Leibler divergence between two probability measures belonging to different exponential families dominated by the same measure, we obtain a formula that generalizes the ordinary Fenchel–Young divergence. Inspire...

(This article belongs to the Special Issue Information and Divergence Measures)
  • Article
  • Open Access
11 Citations
3,619 Views
12 Pages

H∞ Observer Based on Descriptor Systems Applied to Estimate the State of Charge

  • Shengya Meng,
  • Shihong Li,
  • Heng Chi,
  • Fanwei Meng and
  • Aiping Pang

17 March 2022

This paper proposes an H∞ observer based on descriptor systems to estimate the state of charge (SOC). The battery’s open-current voltage is chosen as a generalized state variable, thereby avoiding the artificial derivative calculation of...

(This article belongs to the Special Issue Nonlinear Control Systems with Recent Advances and Applications)
  • Feature Paper
  • Article
  • Open Access
1 Citations
3,585 Views
15 Pages

17 March 2022

We reconsider model II of Orban et al. (J. Chem. Phys. 1968, 49, 1778–1783), a two-dimensional lattice-gas system featuring a crystalline phase and two distinct fluid phases (liquid and vapor). In this system, a particle prevents other par...

(This article belongs to the Special Issue Statistical Mechanics and Thermodynamics of Liquids and Crystals II)
  • Article
  • Open Access
12 Citations
3,861 Views
23 Pages

Adaptive Hurst-Sensitive Active Queue Management

  • Dariusz Marek,
  • Jakub Szyguła,
  • Adam Domański,
  • Joanna Domańska and ,
  • Katarzyna Filus and
  • Marta Szczygieł
  • + 1 author+ 0 author

17 March 2022

An Active Queue Management (AQM) mechanism, recommended by the Internet Engineering Task Force (IETF), increases the efficiency of network transmission. An example of this type of algorithm can be the Random Early Detection (RED) algorithm. The behav...

  • Feature Paper
  • Article
  • Open Access
18 Citations
5,807 Views
12 Pages

A Robust Protocol for Entropy Measurement in Mesoscopic Circuits

  • Timothy Child,
  • Owen Sheekey,
  • Silvia Lüscher,
  • Saeed Fallahi and ,
  • Geoffrey C. Gardner,
  • Michael Manfra and
  • Joshua Folk
  • + 2 authors+ 0 author

17 March 2022

Previous measurements utilizing Maxwell relations to measure change in entropy, S, demonstrated remarkable accuracy in measuring the spin-1/2 entropy of electrons in a weakly coupled quantum dot. However, these previous measurements relied upon prior...

(This article belongs to the Special Issue Nature of Entropy and Its Direct Metrology)
  • Article
  • Open Access
14 Citations
3,929 Views
17 Pages

16 March 2022

Pressure drop, heat transfer, and energy performance of ZnO/water nanofluid with rodlike particles flowing through a curved pipe are studied in the range of Reynolds number 5000 ≤ Re ≤ 30,000, particle volume concentration 0.1% ≤ Φ ≤...

(This article belongs to the Special Issue Entropy Generation Analysis in Near-Wall Turbulent Flow)
  • Article
  • Open Access
3,442 Views
17 Pages

16 March 2022

Recently, flow models parameterized by neural networks have been used to design efficient Markov chain Monte Carlo (MCMC) transition kernels. However, inefficient utilization of gradient information of the target distribution or the use of volume-pre...

  • Article
  • Open Access
22 Citations
4,830 Views
17 Pages

Speaker Recognition Using Constrained Convolutional Neural Networks in Emotional Speech

  • Nikola Simić,
  • Siniša Suzić,
  • Tijana Nosek,
  • Mia Vujović and ,
  • Zoran Perić,
  • Milan Savić and
  • Vlado Delić
  • + 2 authors+ 0 author

16 March 2022

Speaker recognition is an important classification task, which can be solved using several approaches. Although building a speaker recognition model on a closed set of speakers under neutral speaking conditions is a well-researched task and there are...

(This article belongs to the Special Issue Methods in Artificial Intelligence and Information Processing)
  • Correction
  • Open Access
1 Citations
2,132 Views
2 Pages

16 March 2022

The authors wish to make the following correction to this paper [...]

(This article belongs to the Special Issue Selected Papers from 45th Conference of the Middle European Cooperation in Statistical Physics)
  • Article
  • Open Access
7 Citations
4,517 Views
23 Pages

ABCAttack: A Gradient-Free Optimization Black-Box Attack for Fooling Deep Image Classifiers

  • Han Cao,
  • Chengxiang Si,
  • Qindong Sun,
  • Yanxiao Liu and ,
  • Shancang Li and
  • Prosanta Gope
  • + 1 author+ 0 author

15 March 2022

The vulnerability of deep neural network (DNN)-based systems makes them susceptible to adversarial perturbation and may cause classification task failure. In this work, we propose an adversarial attack model using the Artificial Bee Colony (ABC) algo...

(This article belongs to the Special Issue Information Theory and Its Applications in Multimedia Security and Processing)
  • Article
  • Open Access
7 Citations
3,148 Views
16 Pages

Multiband Spectrum Sensing Based on the Sample Entropy

  • Yanqueleth Molina-Tenorio,
  • Alfonso Prieto-Guerrero and
  • Rafael Aguilar-Gonzalez

15 March 2022

Cognitive radios represent a real alternative to the scarcity of the radio spectrum. One of the primary tasks of these radios is the detection of possible gaps in a given bandwidth used by licensed users (called also primary users). This task, called...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
3 Citations
6,723 Views
15 Pages

15 March 2022

This paper elaborates on the interpretation of time and entanglement, offering insights into the possible ontological nature of information in the emergence of spacetime, towards a quantum description of gravity. We first investigate different perspe...

(This article belongs to the Section Time)
  • Article
  • Open Access
2 Citations
3,347 Views
15 Pages

15 March 2022

Characterizing the topology and random walk of a random network is difficult because the connections in the network are uncertain. We propose a class of the generalized weighted Koch network by replacing the triangles in the traditional Koch network...

  • Article
  • Open Access
17 Citations
6,733 Views
15 Pages

A Hybrid Method Using HAVOK Analysis and Machine Learning for Predicting Chaotic Time Series

  • Jinhui Yang,
  • Juan Zhao,
  • Junqiang Song,
  • Jianping Wu and ,
  • Chengwu Zhao and
  • Hongze Leng
  • + 1 author+ 0 author

15 March 2022

The prediction of chaotic time series systems has remained a challenging problem in recent decades. A hybrid method using Hankel Alternative View Of Koopman (HAVOK) analysis and machine learning (HAVOK-ML) is developed to predict chaotic time series....

(This article belongs to the Topic Artificial Intelligence and Computational Methods: Modeling, Simulations and Optimization of Complex Systems)
  • Article
  • Open Access
5 Citations
3,010 Views
11 Pages

f-Gintropy: An Entropic Distance Ranking Based on the Gini Index

  • Tamás Sándor Biró,
  • András Telcs,
  • Máté Józsa and
  • Zoltán Néda

14 March 2022

We consider an entropic distance analog quantity based on the density of the Gini index in the Lorenz map, i.e., gintropy. Such a quantity might be used for pairwise mapping and ranking between various countries and regions based on income and wealth...

(This article belongs to the Special Issue Information Geometry, Complexity Measures and Data Analysis)
  • Article
  • Open Access
5 Citations
3,050 Views
10 Pages

14 March 2022

An approach for the cryptographic security enhancement of encryption is proposed and analyzed. The enhancement is based on the employment of a coding scheme and degradation of the ciphertext. From the perspective of the legitimate parties that share...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
4 Citations
3,993 Views
19 Pages

14 March 2022

Cell populations are often characterised by phenotypic heterogeneity in the form of two distinct subpopulations. We consider a model of tumour cells consisting of two subpopulations: non-cancer promoting (NCP) and cancer-promoting (CP). Under steady...

(This article belongs to the Special Issue The Principle of Dynamical Criticality)
  • Article
  • Open Access
3 Citations
3,441 Views
38 Pages

14 March 2022

Differential privacy (DP) has become a de facto standard to achieve data privacy. However, the utility of DP solutions with the premise of privacy priority is often unacceptable in real-world applications. In this paper, we propose the best-effort di...

(This article belongs to the Special Issue Adversarial Intelligence: Secrecy, Privacy, and Robustness)
  • Feature Paper
  • Article
  • Open Access
70 Citations
14,134 Views
34 Pages

13 March 2022

We consider the “partial information decomposition” (PID) problem, which aims to decompose the information that a set of source random variables provide about a target random variable into separate redundant, synergistic, union, and uniqu...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
13 Citations
4,810 Views
23 Pages

13 March 2022

A data-driven prediction method is proposed to predict the soft fault and estimate the service life of a DC–DC-converter circuit. First, based on adaptive online non-bias least-square support-vector machine (AONBLSSVM) and the double-population...

(This article belongs to the Special Issue Entropy for Machine Learning and Complex Systems Toward Regional Sustainable Development)
  • Article
  • Open Access
4 Citations
4,215 Views
25 Pages

13 March 2022

Intuitively, the level of autonomy of an agent is related to the degree to which the agent’s goals and behaviour are decoupled from the immediate control by the environment. Here, we capitalise on a recent information-theoretic formulation of a...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
5 Citations
3,002 Views
13 Pages

13 March 2022

Asymmetric behaviour has been documented in unemployment rates which increase quickly in recessions but decline relatively slowly during expansions. To model such asymmetric dynamics, this paper provides a rigorous derivation of the asymmetric mean-r...

(This article belongs to the Section Statistical Physics)
  • Article
  • Open Access
8 Citations
2,750 Views
15 Pages

13 March 2022

In several applications, the assumption of normality is often violated in data with some level of skewness, so skewness affects the mean’s estimation. The class of skew–normal distributions is considered, given their flexibility for model...

(This article belongs to the Special Issue Distance in Information and Statistical Physics III)
  • Article
  • Open Access
21 Citations
7,319 Views
18 Pages

12 March 2022

With the development of Internet technology, short texts have gradually become the main medium for people to obtain information and communicate. Short text reduces the threshold of information production and reading by virtue of its short length, whi...

  • Article
  • Open Access
6 Citations
2,639 Views
10 Pages

12 March 2022

In this paper, four kinds of shadowing properties in non-autonomous discrete dynamical systems (NDDSs) are discussed. It is pointed out that if an NDDS has a F-shadowing property (resp. ergodic shadowing property, d¯ shadowing property, d̲...

(This article belongs to the Special Issue Dynamical Systems, Differential Equations and Applications)
  • Article
  • Open Access
3 Citations
3,476 Views
26 Pages

Minimum Adversarial Examples

  • Zhenyu Du,
  • Fangzheng Liu and
  • Xuehu Yan

12 March 2022

Deep neural networks in the area of information security are facing a severe threat from adversarial examples (AEs). Existing methods of AE generation use two optimization models: (1) taking the successful attack as the objective function and limitin...

(This article belongs to the Special Issue Information Theory and Its Applications in Multimedia Security and Processing)
  • Article
  • Open Access
6 Citations
3,671 Views
23 Pages

Memory Effects in High-Dimensional Systems Faithfully Identified by Hilbert–Schmidt Speed-Based Witness

  • Kobra Mahdavipour,
  • Mahshid Khazaei Shadfar,
  • Hossein Rangani Jahromi,
  • Roberto Morandotti and
  • Rosario Lo Franco

12 March 2022

A witness of non-Markovianity based on the Hilbert–Schmidt speed (HSS), a special type of quantum statistical speed, has been recently introduced for low-dimensional quantum systems. Such a non-Markovianity witness is particularly useful, being...

(This article belongs to the Special Issue Quantum Information Concepts in Open Quantum Systems)
  • Article
  • Open Access
51 Citations
11,571 Views
14 Pages

11 March 2022

Quantum machine learning is a promising application of quantum computing for data classification. However, most of the previous research focused on binary classification, and there are few studies on multi-classification. The major challenge comes fr...

(This article belongs to the Topic Quantum Information and Quantum Computing)
  • Article
  • Open Access
66 Citations
8,859 Views
20 Pages

CT and MRI Medical Image Fusion Using Noise-Removal and Contrast Enhancement Scheme with Convolutional Neural Network

  • Jameel Ahmed Bhutto,
  • Lianfang Tian,
  • Qiliang Du,
  • Zhengzheng Sun and ,
  • Lubin Yu and
  • Muhammad Faizan Tahir
  • + 1 author+ 0 author

11 March 2022

Medical image fusion (MIF) has received painstaking attention due to its diverse medical applications in response to accurately diagnosing clinical images. Numerous MIF methods have been proposed to date, but the fused image suffers from poor contras...

(This article belongs to the Special Issue Information Theory in Emerging Biomedical Applications)
  • Article
  • Open Access
4 Citations
4,961 Views
21 Pages

11 March 2022

The II law of thermodynamics is most often given in three supposedly equivalent formulations: two Clausius (I and II) and one Kelvin. The most general and indisputable entropy formulation belongs to Clausius (II). The earlier Clausius I principle det...

(This article belongs to the Special Issue Dissipative, Entropy-Production Systems across Condensed Matter and Interdisciplinary Classical VS. Quantum Physics)
  • Article
  • Open Access
1 Citations
3,508 Views
15 Pages

11 March 2022

In this paper, we focus on some aspects of the relation of spacetime and quantum mechanics and the study counterparts (in Set) of the categorical local symmetries of smooth 4-manifolds. In the set-theoretic limit, there emerge some exotic smoothness...

(This article belongs to the Section Time)
  • Review
  • Open Access
46 Citations
10,001 Views
18 Pages

11 March 2022

The availability of powerful non-invasive neuroimaging techniques has given rise to various studies that aim to map the human brain. These studies focus on not only finding brain activation signatures but also on understanding the overall organizatio...

(This article belongs to the Special Issue Big Data Analytics and Information Science for Business and Biomedical Applications II)
  • Feature Paper
  • Review
  • Open Access
6 Citations
4,876 Views
21 Pages

10 March 2022

Stochastic resonance in clusters of major histocompatibility molecules is extended by a more detailed description of adaptive thresholding and by applying the notion of suprathreshold stochastic resonance as a stochastically quantizing encoder of tra...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
14 Citations
4,847 Views
23 Pages

Metaheuristic Algorithms Based on Compromise Programming for the Multi-Objective Urban Shipment Problem

  • Tung Son Ngo,
  • Jafreezal Jaafar,
  • Izzatdin Abdul Aziz,
  • Muhammad Umar Aftab and ,
  • Hoang Giang Nguyen and
  • Ngoc Anh Bui
  • + 1 author+ 0 author

9 March 2022

The Vehicle Routing Problem (VRP) and its variants are found in many fields, especially logistics. In this study, we introduced an adaptive method to a complex VRP. It combines multi-objective optimization and several forms of VRPs with practical req...

(This article belongs to the Special Issue Entropy in Soft Computing and Machine Learning Algorithms)
  • Article
  • Open Access
13 Citations
3,919 Views
25 Pages

9 March 2022

Missing covariates in regression or classification problems can prohibit the direct use of advanced tools for further analysis. Recent research has realized an increasing trend towards the use of modern Machine-Learning algorithms for imputation. Thi...

(This article belongs to the Special Issue Improving Predictive Models with Expert Knowledge)
  • Article
  • Open Access
7 Citations
4,131 Views
11 Pages

The Generalized Euler Characteristics of the Graphs Split at Vertices

  • Omer Farooq,
  • Michał Ławniczak,
  • Afshin Akhshani,
  • Szymon Bauch and
  • Leszek Sirko

9 March 2022

We show that there is a relationship between the generalized Euler characteristic Eo(|VDo|) of the original graph that was split at vertices into two disconnected subgraphs i=1,2 and their generalized Euler characteristics Ei(|VDi|). Here, |VDo| and...

(This article belongs to the Special Issue Dissipative, Entropy-Production Systems across Condensed Matter and Interdisciplinary Classical VS. Quantum Physics)
  • Article
  • Open Access
5 Citations
8,093 Views
14 Pages

9 March 2022

We consider the role information energy can play as a source of dark energy. Firstly, we note that if stars and structure had not formed in the universe, elemental bits of information describing the attributes of particles would have exhibited proper...

(This article belongs to the Section Astrophysics, Cosmology, and Black Holes)
  • Article
  • Open Access
13 Citations
3,664 Views
20 Pages

A Novel and Fast Encryption System Based on Improved Josephus Scrambling and Chaotic Mapping

  • Zhaoxiong Guan,
  • Junxian Li,
  • Linqing Huang,
  • Xiaoming Xiong and ,
  • Yuan Liu and
  • Shuting Cai
  • + 1 author+ 0 author

9 March 2022

To address the shortcomings of weak confusion and high time complexity of the existing permutation algorithms, including the traditional Josephus ring permutation (TJRP), an improved Josephus ring-based permutation (IJRBP) algorithm is developed. The...

(This article belongs to the Section Complexity)

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300