Skip to Content

Entropy, Volume 23, Issue 6

2021 June - 148 articles

Cover Story: The thermodynamics of information and computation examines the requirements for a physical process that manipulates information to approach thermodynamic reversibility. A key principle, due to Landauer, tells us that a strict increase in total entropy results from the loss of correlations (i.e., mutual information) between deterministically computed subsystems when information in isolated subsystems is ejected to a thermal environment. Reversible computing refers to computation without ejection of correlated information, which can avoid the associated entropy increase. We show that the classic understanding of these topics from Landauer and Bennett is supported by the modern theory of non-equilibrium quantum thermodynamics, and we outline an approach for deriving fundamental limits of energy efficiency in reversible computing machines as a function of speed. View this paper.
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (148)

  • Article
  • Open Access
15 Citations
4,418 Views
20 Pages

Are Mobility and COVID-19 Related? A Dynamic Analysis for Portuguese Districts

  • António Casa Nova,
  • Paulo Ferreira,
  • Dora Almeida,
  • Andreia Dionísio and
  • Derick Quintino

21 June 2021

In this research work, we propose to assess the dynamic correlation between different mobility indices, measured on a daily basis, and the new cases of COVID-19 in the different Portuguese districts. The analysis is based on global correlation measur...

(This article belongs to the Special Issue Three Risky Decades: A Time for Econophysics?)
  • Article
  • Open Access
14 Citations
4,611 Views
21 Pages

20 June 2021

Modeling of wall-bounded turbulent flows is still an open problem in classical physics, with relatively slow progress in the last few decades beyond the log law, which only describes the intermediate region in wall-bounded turbulence, i.e., 30–50 y+...

(This article belongs to the Special Issue Fractional Calculus and the Future of Science)
  • Article
  • Open Access
41 Citations
25,154 Views
57 Pages

20 June 2021

Drawing from both enactivist and cognitivist perspectives on mind, I propose that explaining teleological phenomena may require reappraising both “Cartesian theaters” and mental homunculi in terms of embodied self-models (ESMs), understood as body ma...

(This article belongs to the Special Issue Applying the Free-Energy Principle to Complex Adaptive Systems)
  • Article
  • Open Access
5,005 Views
14 Pages

20 June 2021

Accurate estimation of channel log-likelihood ratio (LLR) is crucial to the decoding of modern channel codes like turbo, low-density parity-check (LDPC), and polar codes. Under an additive white Gaussian noise (AWGN) channel, the calculation of LLR i...

(This article belongs to the Special Issue Information Theory for Channel Coding)
  • Article
  • Open Access
8 Citations
3,835 Views
20 Pages

20 June 2021

In this paper, we propose a spectrum-sharing protocol for a cooperative cognitive radio network based on non-orthogonal multiple access technology, where the base station (BS) transmits the superimposed signal to the primary user and secondary user w...

(This article belongs to the Special Issue Information Theory and Coding for Wireless Communications)
  • Article
  • Open Access
10 Citations
4,611 Views
16 Pages

Multivariable Heuristic Approach to Intrusion Detection in Network Environments

  • Marcin Niemiec,
  • Rafał Kościej and
  • Bartłomiej Gdowski

19 June 2021

The Internet is an inseparable part of our contemporary lives. This means that protection against threats and attacks is crucial for major companies and for individual users. There is a demand for the ongoing development of methods for ensuring secur...

(This article belongs to the Section Signal and Data Analysis)
  • Article
  • Open Access
28 Citations
6,845 Views
19 Pages

Deep Learning for Walking Behaviour Detection in Elderly People Using Smart Footwear

  • Rocío Aznar-Gimeno,
  • Gorka Labata-Lezaun,
  • Ana Adell-Lamora,
  • David Abadía-Gallego and ,
  • Rafael del-Hoyo-Alonso and
  • Carlos González-Muñoz
  • + 1 author+ 0 author

19 June 2021

The increase in the proportion of elderly in Europe brings with it certain challenges that society needs to address, such as custodial care. We propose a scalable, easily modulated and live assistive technology system, based on a comfortable smart fo...

(This article belongs to the Special Issue Sensor Data Analytics: Challenges and Methods for Data-Intensive Applications)
  • Article
  • Open Access
27 Citations
8,865 Views
16 Pages

19 June 2021

Differential entropy can be negative, while discrete entropy is always non-negative. This article shows that negative entropy is a significant flaw when entropy is used as a sensitivity measure in global sensitivity analysis. Global sensitivity analy...

(This article belongs to the Special Issue Entropy for Machine Learning and Complex Systems Toward Regional Sustainable Development)
  • Article
  • Open Access
12 Citations
4,862 Views
13 Pages

Socioeconomic Patterns of Twitter User Activity

  • Jacob Levy Abitbol and
  • Alfredo J. Morales

19 June 2021

Stratifying behaviors based on demographics and socioeconomic status is crucial for political and economic planning. Traditional methods to gather income and demographic information, like national censuses, require costly large-scale surveys both in...

(This article belongs to the Special Issue Swarms and Network Intelligence)
  • Article
  • Open Access
2 Citations
3,028 Views
15 Pages

19 June 2021

In this paper, we study the basic problem of a charged particle in a stochastic magnetic field. We consider dichotomous fluctuations of the magnetic field where the sojourn time in one of the two states are distributed according to a given waiting-ti...

(This article belongs to the Section Statistical Physics)
  • Article
  • Open Access
15 Citations
6,227 Views
21 Pages

18 June 2021

This study investigates the hybridization scenario of a single-flash geothermal power plant with a biomass-driven sCO2-steam Rankine combined cycle, where a solid local biomass source, olive residue, is used as a fuel. The hybrid power plant is model...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
8 Citations
3,173 Views
15 Pages

Why Dilated Convolutional Neural Networks: A Proof of Their Optimality

  • Jonatan Contreras,
  • Martine Ceberio and
  • Vladik Kreinovich

18 June 2021

One of the most effective image processing techniques is the use of convolutional neural networks that use convolutional layers. In each such layer, the value of the layer’s output signal at each point is a combination of the layer’s input signals co...

(This article belongs to the Special Issue Fractal and Multifractal Analysis of Complex Networks)
  • Article
  • Open Access
16 Citations
5,658 Views
19 Pages

Meta-Tree Random Forest: Probabilistic Data-Generative Model and Bayes Optimal Prediction

  • Nao Dobashi,
  • Shota Saito,
  • Yuta Nakahara and
  • Toshiyasu Matsushima

18 June 2021

This paper deals with a prediction problem of a new targeting variable corresponding to a new explanatory variable given a training dataset. To predict the targeting variable, we consider a model tree, which is used to represent a conditional probabi...

  • Article
  • Open Access
6 Citations
3,798 Views
20 Pages

No-Reference Quality Assessment for 3D Synthesized Images Based on Visual-Entropy-Guided Multi-Layer Features Analysis

  • Chongchong Jin,
  • Zongju Peng,
  • Wenhui Zou,
  • Fen Chen and ,
  • Gangyi Jiang and
  • Mei Yu
  • + 1 author+ 0 author

18 June 2021

Multiview video plus depth is one of the mainstream representations of 3D scenes in emerging free viewpoint video, which generates virtual 3D synthesized images through a depth-image-based-rendering (DIBR) technique. However, the inaccuracy of depth...

(This article belongs to the Special Issue Towards Image/Video Perception with Entropy-Aware Features and Its Applications)
  • Article
  • Open Access
21 Citations
4,137 Views
18 Pages

18 June 2021

A cyber-physical supply network is composed of an undirected cyber supply network and a directed physical supply network. Such interdependence among firms increases efficiency but creates more vulnerabilities. The adverse effects of any failure can b...

(This article belongs to the Special Issue Analysis and Applications of Complex Social Networks)
  • Article
  • Open Access
3 Citations
3,947 Views
13 Pages

18 June 2021

Collected network data are often incomplete, with both missing nodes and missing edges. Thus, network completion that infers the unobserved part of the network is essential for downstream tasks. Despite the emerging literature related to network reco...

(This article belongs to the Collection Social Sciences)
  • Article
  • Open Access
6 Citations
7,072 Views
18 Pages

18 June 2021

Time is one of the undisputed foundations of our life in the real world. Here it is argued that inside small isolated quantum systems, time does not pass as we are used to, and it is primarily in this sense that quantum objects enjoy only limited rea...

(This article belongs to the Special Issue Time, Causality, and Entropy)
  • Article
  • Open Access
7 Citations
4,569 Views
22 Pages

Robust Universal Inference

  • Amichai Painsky and
  • Meir Feder

18 June 2021

Learning and making inference from a finite set of samples are among the fundamental problems in science. In most popular applications, the paradigmatic approach is to seek a model that best explains the data. This approach has many desirable propert...

(This article belongs to the Special Issue Applications of Information Theory in Statistics)
  • Article
  • Open Access
48 Citations
4,346 Views
11 Pages

18 June 2021

Distinguishing the types of partial discharge (PD) caused by different insulation defects in gas-insulated switchgear (GIS) is a great challenge in the power industry, and improving the recognition accuracy of the relevant models is one of the key pr...

  • Article
  • Open Access
1 Citations
3,490 Views
10 Pages

Confined Quantum Hard Spheres

  • Sergio Contreras and
  • Alejandro Gil-Villegas

18 June 2021

We present computer simulation and theoretical results for a system of N Quantum Hard Spheres (QHS) particles of diameter σ and mass m at temperature T, confined between parallel hard walls separated by a distance Hσ, within the range 1≤H≤∞. Semiclas...

(This article belongs to the Section Statistical Physics)
  • Article
  • Open Access
30 Citations
5,048 Views
23 Pages

Assessment of Classification Models and Relevant Features on Nonalcoholic Steatohepatitis Using Random Forest

  • Rafael García-Carretero,
  • Roberto Holgado-Cuadrado and
  • Óscar Barquero-Pérez

17 June 2021

Nonalcoholic fatty liver disease (NAFLD) is the hepatic manifestation of metabolic syndrome and is the most common cause of chronic liver disease in developed countries. Certain conditions, including mild inflammation biomarkers, dyslipidemia, and in...

(This article belongs to the Special Issue Selected Papers from 38th Annual Conference of Spanish Society of Biomedical Engineering)
  • Article
  • Open Access
3 Citations
3,026 Views
19 Pages

17 June 2021

Control loop performance assessment (CPA) is essential in the operation of industrial systems. In this paper, the shortcomings of existing performance assessment methods and indicators are summarized firstly, and a novel evaluation method based on ge...

  • Article
  • Open Access
3 Citations
3,412 Views
32 Pages

17 June 2021

This paper considers the periodic self-exciting threshold integer-valued autoregressive processes under a weaker condition in which the second moment is finite instead of the innovation distribution being given. The basic statistical properties of th...

(This article belongs to the Special Issue Time Series Modelling)
  • Article
  • Open Access
3,415 Views
15 Pages

16 June 2021

The classical Schalkwijk–Kailath (SK) scheme for the point-to-point white Gaussian channel with noiseless feedback plays an important role in information theory due to the fact that it is capacity-achieving and the complexity of its encoding–decoding...

  • Article
  • Open Access
13 Citations
5,745 Views
12 Pages

16 June 2021

The emergence of global order in complex systems with locally interacting components is most striking at criticality, where small changes in control parameters result in a sudden global reorganization. We study the thermodynamic efficiency of interac...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
359 Citations
23,041 Views
17 Pages

16 June 2021

Grouping the objects based on their similarities is an important common task in machine learning applications. Many clustering methods have been developed, among them k-means based clustering methods have been broadly used and several extensions have...

(This article belongs to the Special Issue Machine/Statistical Learning and Modeling with Potential Applications in Entropy, Information Theory, and Artificial Intelligence)
  • Article
  • Open Access
19 Citations
6,136 Views
30 Pages

A Coupling Framework for Multi-Domain Modelling and Multi-Physics Simulations

  • Dario Amirante,
  • Vlad Ganine,
  • Nicholas J. Hills and
  • Paolo Adami

16 June 2021

This paper describes a coupling framework for parallel execution of different solvers for multi-physics and multi-domain simulations with an arbitrary number of adjacent zones connected by different physical or overlapping interfaces. The coupling ar...

(This article belongs to the Special Issue Computational Fluid Dynamics and Conjugate Heat Transfer)
  • Article
  • Open Access
1 Citations
3,019 Views
14 Pages

16 June 2021

Atmospheric continuous-variable quantum key distribution (ACVQKD) has been proven to be secure theoretically with the assumption that the signal source is well protected by the sender so that it cannot be compromised. However, this assumption is quit...

(This article belongs to the Special Issue Quantum Communication)
  • Article
  • Open Access
17 Citations
3,754 Views
13 Pages

A Two-Steps-Ahead Estimator for Bubble Entropy

  • George Manis,
  • Matteo Bodini,
  • Massimo W. Rivolta and
  • Roberto Sassi

16 June 2021

Aims: Bubble entropy (bEn) is an entropy metric with a limited dependence on parameters. bEn does not directly quantify the conditional entropy of the series, but it assesses the change in entropy of the ordering of portions of its samples of length...

(This article belongs to the Special Issue Entropy in Biomedical Engineering)
  • Article
  • Open Access
97 Citations
6,522 Views
23 Pages

16 June 2021

The goal of the paper is to present a solution to improve the fault detection accuracy of rolling bearings. The method is based on variational mode decomposition (VMD), multiscale permutation entropy (MPE) and the particle swarm optimization-based su...

  • Article
  • Open Access
5 Citations
3,329 Views
19 Pages

Improved Local Search with Momentum for Bayesian Networks Structure Learning

  • Xiaohan Liu,
  • Xiaoguang Gao,
  • Zidong Wang and
  • Xinxin Ru

15 June 2021

Bayesian Networks structure learning (BNSL) is a troublesome problem that aims to search for an optimal structure. An exact search tends to sacrifice a significant amount of time and memory to promote accuracy, while the local search can tackle compl...

(This article belongs to the Special Issue Bayesian Inference in Probabilistic Graphical Models)
  • Article
  • Open Access
56 Citations
5,790 Views
17 Pages

15 June 2021

This paper proposes a data-driven method-based fault diagnosis method using the deep convolutional neural network (DCNN). The DCNN is used to deal with sensor and actuator faults of robot joints, such as gain error, offset error, and malfunction for...

(This article belongs to the Special Issue Complex Dynamic System Modelling, Identification and Control)
  • Article
  • Open Access
2 Citations
3,775 Views
22 Pages

Reducing Cognitive Effort in Scoring Negotiation Space Using the Fuzzy Clustering Model

  • Marzena Filipowicz-Chomko,
  • Rafał Mierzwiak,
  • Marcin Nowak,
  • Ewa Roszkowska and
  • Tomasz Wachowicz

15 June 2021

Negotiation scoring systems are fundamental tools used in negotiation support to facilitate parties searching for negotiation agreement and analyzing its efficiency and fairness. Such a scoring system is obtained in prenegotiation by implementing sel...

(This article belongs to the Special Issue Decision Making, Classical and Quantum Optimization Methods)
  • Article
  • Open Access
9 Citations
3,611 Views
14 Pages

The Value of Heart Rhythm Complexity in Identifying High-Risk Pulmonary Hypertension Patients

  • Shu-Yu Tang,
  • Hsi-Pin Ma,
  • Chi-Sheng Hung,
  • Ping-Hung Kuo and ,
  • Chen Lin,
  • Men-Tzung Lo,
  • Hsao-Hsun Hsu,
  • Yu-Wei Chiu,
  • Cho-Kai Wu and
  • Yen-Hung Lin
  • + 8 authors+ 3 authors

15 June 2021

Pulmonary hypertension (PH) is a fatal disease—even with state-of-the-art medical treatment. Non-invasive clinical tools for risk stratification are still lacking. The aim of this study was to investigate the clinical utility of heart rhythm complexi...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
2 Citations
3,700 Views
16 Pages

Entropy Optimization, Maxwell–Boltzmann, and Rayleigh Distributions

  • Nicy Sebastian,
  • Arak M. Mathai and
  • Hans J. Haubold

15 June 2021

In physics, communication theory, engineering, statistics, and other areas, one of the methods of deriving distributions is the optimization of an appropriate measure of entropy under relevant constraints. In this paper, it is shown that by optimizin...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
3 Citations
3,595 Views
43 Pages

Currencies in Resource Theories

  • Lea Kraemer and
  • Lídia del Rio

15 June 2021

How may we quantify the value of physical resources, such as entangled quantum states, heat baths or lasers? Existing resource theories give us partial answers; however, these rely on idealizations, like perfectly independent copies of states or exac...

(This article belongs to the Special Issue Thermodynamics of Quantum Information)
  • Article
  • Open Access
13 Citations
5,280 Views
17 Pages

Self-Supervised Variational Auto-Encoders

  • Ioannis Gatopoulos and
  • Jakub M. Tomczak

14 June 2021

Density estimation, compression, and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models, called self...

(This article belongs to the Special Issue Probabilistic Methods for Deep Learning)
  • Article
  • Open Access
11 Citations
5,079 Views
12 Pages

Objective Quantum Fields, Retrocausality and Ontology

  • Peter D. Drummond and
  • Margaret D. Reid

14 June 2021

We compare different approaches to quantum ontology. In particular, we discuss an interpretation of quantum mechanics that we call objective quantum field theory (OQFT), which involves retrocausal fields. Here, objective implies the existence of fiel...

(This article belongs to the Special Issue Quantum Theory and Causation)
  • Article
  • Open Access
7 Citations
4,257 Views
17 Pages

Local Fractal Connections to Characterize the Spatial Processes of Deforestation in the Ecuadorian Amazon

  • Andrea Urgilez-Clavijo,
  • David Andrés Rivas-Tabares,
  • Juan José Martín-Sotoca and
  • Ana María Tarquis Alfonso

14 June 2021

Deforestation by human activities is a common issue in Amazonian countries. This occurs at different spatial and temporal scales causing primary forest loss and land fragmentation issues. During the deforestation process as the forest loses connectiv...

(This article belongs to the Special Issue Selected Papers from the Ninth International Conference on Complex Networks and Their Applications)
  • Article
  • Open Access
1 Citations
3,247 Views
11 Pages

Quantum Advantages of Communication Complexity from Bell Nonlocality

  • Zhih-Ahn Jia,
  • Lu Wei,
  • Yu-Chun Wu and
  • Guang-Can Guo

13 June 2021

Communication games are crucial tools for investigating the limitations of physical theories. The communication complexity (CC) problem is a typical example, for which several distributed parties attempt to jointly calculate a given function with lim...

  • Article
  • Open Access
79 Citations
9,564 Views
15 Pages

Retinex-Based Fast Algorithm for Low-Light Image Enhancement

  • Shouxin Liu,
  • Wei Long,
  • Lei He,
  • Yanyan Li and
  • Wei Ding

13 June 2021

We proposed the Retinex-based fast algorithm (RBFA) to achieve low-light image enhancement in this paper, which can restore information that is covered by low illuminance. The proposed algorithm consists of the following parts. Firstly, we convert th...

(This article belongs to the Special Issue Entropy in Image Analysis III)
  • Article
  • Open Access
5 Citations
3,581 Views
18 Pages

13 June 2021

The bounded rationality mainstream is based on interesting experiments showing human behaviors violating classical probability (CP) laws. Quantum probability (QP) has been shown to successfully figure out such issues, supporting the hypothesis that q...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
1 Citations
3,478 Views
16 Pages

12 June 2021

In this manuscript, we analyze a bivariate vector auto-regressive (VAR) model in order to draw the design principle of a timeseries with a controlled statistical inter-relationship. We show how to generate bivariate timeseries with given covariance a...

(This article belongs to the Special Issue Measures of Information)
  • Article
  • Open Access
11 Citations
4,222 Views
22 Pages

A Nonlinear Maximum Correntropy Information Filter for High-Dimensional Neural Decoding

  • Xi Liu,
  • Shuhang Chen,
  • Xiang Shen,
  • Xiang Zhang and
  • Yiwen Wang

12 June 2021

Neural signal decoding is a critical technology in brain machine interface (BMI) to interpret movement intention from multi-neural activity collected from paralyzed patients. As a commonly-used decoding algorithm, the Kalman filter is often applied t...

(This article belongs to the Special Issue Information Theory in Deep Learning and Signal Processing for Biomedical Signal Analysis)
  • Article
  • Open Access
2 Citations
3,102 Views
12 Pages

Mixed-Stable Models: An Application to High-Frequency Financial Data

  • Igoris Belovas,
  • Leonidas Sakalauskas,
  • Vadimas Starikovičius and
  • Edward W. Sun

11 June 2021

The paper extends the study of applying the mixed-stable models to the analysis of large sets of high-frequency financial data. The empirical data under review are the German DAX stock index yearly log-returns series. Mixed-stable models for 29 DAX c...

  • Article
  • Open Access
8 Citations
5,078 Views
22 Pages

Computing Accurate Probabilistic Estimates of One-D Entropy from Equiprobable Random Samples

  • Hoshin V. Gupta,
  • Mohammad Reza Ehsani,
  • Tirthankar Roy,
  • Maria A. Sans-Fuentes and ,
  • Uwe Ehret and
  • Ali Behrangi
  • + 1 author+ 0 author

11 June 2021

We develop a simple Quantile Spacing (QS) method for accurate probabilistic estimation of one-dimensional entropy from equiprobable random samples, and compare it with the popular Bin-Counting (BC) and Kernel Density (KD) methods. In contrast to BC,...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
3,869 Views
27 Pages

11 June 2021

In this paper, we study the dynamic risk measures for processes induced by backward stochastic differential equations driven by Teugel’s martingales associated with Lévy processes (BSDELs). The representation theorem for generators of BSDELs is provi...

  • Article
  • Open Access
9 Citations
3,281 Views
26 Pages

11 June 2021

An Unmanned Aerial Vehicle (UAV) can greatly reduce manpower in the agricultural plant protection such as watering, sowing, and pesticide spraying. It is essential to develop a Decision-making Support System (DSS) for UAVs to help them choose the cor...

  • Article
  • Open Access
3 Citations
3,652 Views
28 Pages

Status Set Sequential Pattern Mining Considering Time Windows and Periodic Analysis of Patterns

  • Shenghan Zhou,
  • Houxiang Liu,
  • Bang Chen,
  • Wenkui Hou and ,
  • Xinpeng Ji,
  • Yue Zhang,
  • Wenbing Chang and
  • Yiyong Xiao
  • + 3 authors+ 0 author

11 June 2021

The traditional sequential pattern mining method is carried out considering the whole time period and often ignores the sequential patterns that only occur in local time windows, as well as possible periodicity. Therefore, in order to overcome the li...

(This article belongs to the Special Issue Information-Theoretic Data Mining)

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300