Skip to Content

Entropy, Volume 21, Issue 12

2019 December - 105 articles

Cover Story: The information bottleneck (IB) method is a technique for extracting information in one random variable that is relevant for predicting another random variable. IB has applications in many fields, including machine learning with neural networks. In order to perform IB, however, one must find an optimally-compressed "bottleneck" random variable, which involves solving a difficult optimization problem with an information-theoretic objective function. We propose a method for solving this optimization problem using neural networks and a recently proposed bound on mutual information. We demonstrate that our approach exhibits better performance than other recent proposals. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (105)

  • Review
  • Open Access
27 Citations
12,609 Views
21 Pages

17 December 2019

Consciousness is a central issue in neuroscience, however, we still lack a formal framework that can address the nature of the relationship between consciousness and its physical substrates. In this review, we provide a novel mathematical framework o...

(This article belongs to the Special Issue Integrated Information Theory)
  • Article
  • Open Access
1 Citations
4,803 Views
19 Pages

A Quantum Cellular Automata Type Architecture with Quantum Teleportation for Quantum Computing

  • Dimitrios Ntalaperas,
  • Konstantinos Giannakis and
  • Nikos Konofaos

17 December 2019

We propose an architecture based on Quantum Cellular Automata which allows the use of only one type of quantum gate per computational step, using nearest neighbor interactions. The model is built in partial steps, each one of them analyzed using near...

(This article belongs to the Special Issue Quantum Information Processing)
  • Article
  • Open Access
24 Citations
6,461 Views
13 Pages

17 December 2019

Inspired by the possibility that generative models based on quantum circuits can provide a useful inductive bias for sequence modeling tasks, we propose an efficient training algorithm for a subset of classically simulable quantum circuit models. The...

(This article belongs to the Section Quantum Information)
  • Article
  • Open Access
9 Citations
4,970 Views
16 Pages

Multi-Type Node Detection in Network Communities

  • Chinenye Ezeh,
  • Ren Tao,
  • Li Zhe,
  • Wang Yiqun and
  • Qu Ying

17 December 2019

Patterns of connectivity among nodes on networks can be revealed by community detection algorithms. The great significance of communities in the study of clustering patterns of nodes in different systems has led to the development of various methods...

(This article belongs to the Special Issue Computation in Complex Networks)
  • Article
  • Open Access
29 Citations
3,781 Views
16 Pages

Entropy Generation and Heat Transfer in Drilling Nanoliquids with Clay Nanoparticles

  • Kottakkaran Sooppy Nisar,
  • Dolat Khan,
  • Arshad Khan,
  • Waqar A Khan and ,
  • Ilyas Khan and
  • Abdullah Mohammed Aldawsari
  • + 1 author+ 0 author

16 December 2019

Different types of nanomaterials are used these days. Among them, clay nanoparticles are the one of the most applicable and affordable options. Specifically, clay nanoparticles have numerous applications in the field of medical science for cleaning b...

(This article belongs to the Special Issue Entropy Generation and Heat Transfer II)
  • Article
  • Open Access
21 Citations
6,270 Views
16 Pages

Convolutional Recurrent Neural Networks with a Self-Attention Mechanism for Personnel Performance Prediction

  • Xia Xue,
  • Jun Feng,
  • Yi Gao,
  • Meng Liu and ,
  • Wenyu Zhang,
  • Xia Sun,
  • Aiqi Zhao and
  • Shouxi Guo
  • + 3 authors+ 0 author

16 December 2019

Personnel performance is important for the high-technology industry to ensure its core competitive advantages are present. Therefore, predicting personnel performance is an important research area in human resource management (HRM). In this paper, to...

  • Article
  • Open Access
7 Citations
5,661 Views
25 Pages

16 December 2019

Individuals’ ability to express their subjective experiences in terms of such attributes as pleasant/unpleasant or positive/negative feelings forms a fundamental property of their affect and emotion. However, neuroscientific findings on the und...

(This article belongs to the Special Issue Entropy: The Scientific Tool of the 21st Century)
  • Article
  • Open Access
14 Citations
4,756 Views
16 Pages

Digital Volume Pulse Measured at the Fingertip as an Indicator of Diabetic Peripheral Neuropathy in the Aged and Diabetic

  • Hai-Cheng Wei,
  • Na Ta,
  • Wen-Rui Hu,
  • Ming-Xia Xiao and ,
  • Xiao-Jing Tang,
  • Bagus Haryadi,
  • Juin J. Liou and
  • Hsien-Tsai Wu
  • + 3 authors+ 0 author

16 December 2019

This study investigated the application of a modified percussion entropy index (PEIPPI) in assessing the complexity of baroreflex sensitivity (BRS) for diabetic peripheral neuropathy prognosis. The index was acquired by comparing the obedience of the...

(This article belongs to the Section Signal and Data Analysis)
  • Feature Paper
  • Article
  • Open Access
12 Citations
4,421 Views
16 Pages

16 December 2019

Failure Mode, Effects and Criticality Analysis (FMECA) is a method which involves quantitative failure analysis. It systematically examines potential failure modes in a system, as well as the components of the system, to determine the impact of a fai...

  • Article
  • Open Access
104 Citations
6,601 Views
20 Pages

A New Approach to Fuzzy TOPSIS Method Based on Entropy Measure under Spherical Fuzzy Information

  • Omar Barukab,
  • Saleem Abdullah,
  • Shahzaib Ashraf,
  • Muhammad Arif and
  • Sher Afzal Khan

16 December 2019

Spherical fuzzy set (SFS) is one of the most important and extensive concept to accommodate more uncertainties than existing fuzzy set structures. In this article, we will describe a novel enhanced TOPSIS-based procedure for tackling multi attribute...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
34 Citations
4,850 Views
13 Pages

16 December 2019

Nowadays the importance of thermomechanical engines is recognized worldwide. Since the industrial revolution, physicists and engineers have sought to maximize the efficiency of these machines, but also the mechanical energy or the power output of the...

(This article belongs to the Special Issue Carnot Cycle and Heat Engine Fundamentals and Applications)
  • Article
  • Open Access
26 Citations
6,155 Views
16 Pages

Detecting Causality in Multivariate Time Series via Non-Uniform Embedding

  • Ziyu Jia,
  • Youfang Lin,
  • Zehui Jiao,
  • Yan Ma and
  • Jing Wang

16 December 2019

Causal analysis based on non-uniform embedding schemes is an important way to detect the underlying interactions between dynamic systems. However, there are still some obstacles to estimating high-dimensional conditional mutual information and formin...

(This article belongs to the Special Issue Information Transfer, Entropy Production, Irreversibility and Time Series Analysis)
  • Article
  • Open Access
23 Citations
5,437 Views
21 Pages

Information Theory for Non-Stationary Processes with Stationary Increments

  • Carlos Granero-Belinchón,
  • Stéphane G. Roux and
  • Nicolas B. Garnier

15 December 2019

We describe how to analyze the wide class of non-stationary processes with stationary centered increments using Shannon information theory. To do so, we use a practical viewpoint and define ersatz quantities from time-averaged probability distributio...

(This article belongs to the Special Issue Information Theoretic Measures and Their Applications)
  • Article
  • Open Access
7 Citations
4,195 Views
15 Pages

15 December 2019

Stays at high altitude induce alterations in cardiovascular control and are a model of specific pathological cardiovascular derangements at sea level. However, high-altitude alterations of the complex cardiovascular dynamics remain an almost unexplor...

(This article belongs to the Special Issue Assessing Complexity in Physiological Systems through Biomedical Signals Analysis)
  • Article
  • Open Access
2 Citations
3,390 Views
9 Pages

A Comparative Study of Geoelectric Signals Possibly Associated with the Occurrence of Two Ms > 7 EQs in the South Pacific Coast of Mexico

  • Lev Guzmán-Vargas,
  • Carlos Carrizales-Velazquez,
  • Israel Reyes-Ramírez,
  • Jorge Fonseca-Campos and ,
  • Arturo de la Rosa-Galindo,
  • Víctor O. Quintana-Moreno,
  • José Antonio Peralta and
  • Fernando Angulo-Brown
  • + 3 authors+ 0 author

15 December 2019

During past decades, several studies have suggested the existence of possible seismic electric precursors associated with earthquakes of magnitude M > 7 . However, additional analyses are needed to have more reliable evidence of pattern beh...

(This article belongs to the Special Issue Entropy, Nonlinear Dynamics, and Methods of Complex Systems in Earthquake Physics including Precursory Phenomena II)
  • Article
  • Open Access
37 Citations
5,697 Views
10 Pages

Permutation Entropy and Statistical Complexity Analysis of Brazilian Agricultural Commodities

  • Fernando Henrique Antunes de Araujo,
  • Lucian Bejan,
  • Osvaldo A. Rosso and
  • Tatijana Stosic

14 December 2019

Agricultural commodities are considered perhaps the most important commodities, as any abrupt increase in food prices has serious consequences on food security and welfare, especially in developing countries. In this work, we analyze predictability o...

(This article belongs to the Special Issue Information Theoretic Measures and Their Applications)
  • Article
  • Open Access
10 Citations
4,852 Views
14 Pages

14 December 2019

The purpose of this study is to introduce an improved Luedeking–Piret model that represents a structurally simple biomass concentration approach. The developed routine provides acceptable accuracy when fitting experimental data that incorporate...

(This article belongs to the Special Issue Entropy-Based Algorithms for Signal Processing)
  • Article
  • Open Access
73 Citations
10,532 Views
24 Pages

14 December 2019

Deep Learning (DL) and Artificial Intelligence (AI) tools have shown great success in different areas of medical diagnostics. In this paper, we show another success in orthodontics. In orthodontics, the right treatment timing of many actions and oper...

(This article belongs to the Special Issue MaxEnt 2019—The 39th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering)
  • Editorial
  • Open Access
2 Citations
2,906 Views
4 Pages

The Fractional View of Complexity

  • António M. Lopes and
  • J.A. Tenreiro Machado

13 December 2019

Fractal analysis and fractional differential equations have been proven as useful tools for describing the dynamics of complex phenomena characterized by long memory and spatial heterogeneity [...]

(This article belongs to the Special Issue The Fractional View of Complexity)
  • Article
  • Open Access
52 Citations
10,050 Views
31 Pages

Ordering of Trotterization: Impact on Errors in Quantum Simulation of Electronic Structure

  • Andrew Tranter,
  • Peter J. Love,
  • Florian Mintert,
  • Nathan Wiebe and
  • Peter V. Coveney

13 December 2019

Trotter–Suzuki decompositions are frequently used in the quantum simulation of quantum chemistry. They transform the evolution operator into a form implementable on a quantum device, while incurring an error—the Trotter error. The Trotter...

(This article belongs to the Section Quantum Information)
  • Article
  • Open Access
13 Citations
4,581 Views
40 Pages

13 December 2019

Using a Lyapunov type functional constructed on the basis of thermodynamical arguments, we investigate the finite amplitude stability of internal steady flows of viscoelastic fluids described by the Giesekus model. Using the functional, we derive bou...

(This article belongs to the Special Issue Entropies: Between Information Geometry and Kinetics)
  • Article
  • Open Access
33 Citations
3,963 Views
17 Pages

12 December 2019

Ship-radiated noise signal has a lot of nonlinear, non-Gaussian, and nonstationary information characteristics, which can reflect the important signs of ship performance. This paper proposes a novel feature extraction technique for ship-radiated nois...

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)
  • Article
  • Open Access
24 Citations
5,383 Views
16 Pages

12 December 2019

Massive open online courses (MOOCs), which have been deemed a revolutionary teaching mode, are increasingly being used in higher education. However, there remain deficiencies in understanding the relationship between online behavior of students and t...

(This article belongs to the Special Issue Theory and Applications of Information Theoretic Machine Learning)
  • Article
  • Open Access
9 Citations
5,916 Views
9 Pages

11 December 2019

Synthetic data has been shown to be effective in training state-of-the-art neural machine translation (NMT) systems. Because the synthetic data is often generated by back-translating monolingual data from the target language into the source language,...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
6 Citations
4,306 Views
20 Pages

A Two Phase Method for Solving the Distribution Problem in a Fuzzy Setting

  • Krzysztof Kaczmarek,
  • Ludmila Dymova and
  • Pavel Sevastjanov

11 December 2019

In this paper, a new method for the solution of distribution problem in a fuzzy setting is presented. It consists of two phases. In the first of them, the problem is formulated as the classical, fully fuzzy transportation problem. A new, straightforw...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
3 Citations
3,316 Views
19 Pages

Learning from Both Experts and Data

  • Rémi Besson,
  • Erwan Le Pennec and
  • Stéphanie Allassonnière

10 December 2019

In this work, we study the problem of inferring a discrete probability distribution using both expert knowledge and empirical data. This is an important issue for many applications where the scarcity of data prevents a purely empirical approach. In t...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
21 Citations
4,215 Views
21 Pages

10 December 2019

Entropy is an uncertainty measure of random variables which mathematically represents the prospective quantity of the information. In this paper, we mainly focus on the estimation for the parameters and entropy of an Inverse Weibull distribution unde...

  • Article
  • Open Access
4 Citations
3,806 Views
10 Pages

The Static Standing Postural Stability Measured by Average Entropy

  • Sung-Yang Wei,
  • Chang Francis Hsu,
  • Yun-Ju Lee,
  • Long Hsu and
  • Sien Chi

10 December 2019

Static standing postural stability has been measured by multiscale entropy (MSE), which is used to measure complexity. In this study, we used the average entropy (AE) to measure the static standing postural stability, as AE is a good measure of disor...

  • Article
  • Open Access
43 Citations
11,531 Views
18 Pages

On the Statistical Mechanics of Life: Schrödinger Revisited

  • Kate Jeffery,
  • Robert Pollack and
  • Carlo Rovelli

10 December 2019

We study the statistical underpinnings of life, in particular its increase in order and complexity over evolutionary time. We question some common assumptions about the thermodynamics of life. We recall that contrary to widespread belief, even in a c...

(This article belongs to the Special Issue Biological Statistical Mechanics)
  • Article
  • Open Access
3 Citations
4,012 Views
27 Pages

Dissipation in Non-Steady State Regulatory Circuits

  • Paulina Szymańska-Rożek,
  • Dario Villamaina,
  • Jacek Miȩkisz and
  • Aleksandra M. Walczak

10 December 2019

In order to respond to environmental signals, cells often use small molecular circuits to transmit information about their surroundings. Recently, motivated by specific examples in signaling and gene regulation, a body of work has focused on the prop...

(This article belongs to the Special Issue Information Flow and Entropy Production in Biomolecular Networks)
  • Article
  • Open Access
7 Citations
4,061 Views
22 Pages

9 December 2019

Costa et. al (Frontiers in Physiology (2017) 8255) proved that abnormal features of heart rate variability (HRV) can be discerned by the presence of particular patterns in a signal of time intervals between subsequent heart contractions, called RR in...

(This article belongs to the Special Issue Assessing Complexity in Physiological Systems through Biomedical Signals Analysis)
  • Article
  • Open Access
5 Citations
3,060 Views
14 Pages

9 December 2019

The high fidelity generation of strongly entangled states of many particles, such as cat states, is a particularly demanding challenge. One approach is to drive the system, within a certain final time, as adiabatically as possible, in order to avoid...

(This article belongs to the Special Issue Shortcuts to Adiabaticity)
  • Feature Paper
  • Article
  • Open Access
29 Citations
4,950 Views
17 Pages

A Portable Wireless Device for Cyclic Alternating Pattern Estimation from an EEG Monopolar Derivation

  • Fábio Mendonça,
  • Sheikh Shanawaz Mostafa,
  • Fernando Morgado-Dias and
  • Antonio G. Ravelo-García

7 December 2019

Quality of sleep can be assessed by analyzing the cyclic alternating pattern, a long-lasting periodic activity that is composed of two alternate electroencephalogram patterns, which is considered to be a marker of sleep instability. Experts usually s...

(This article belongs to the Special Issue Intelligent Tools and Applications in Engineering and Mathematics)
  • Article
  • Open Access
3 Citations
4,568 Views
19 Pages

Modeling Expected Shortfall Using Tail Entropy

  • Daniel Traian Pele,
  • Emese Lazar and
  • Miruna Mazurencu-Marinescu-Pele

7 December 2019

Given the recent replacement of value-at-risk as the regulatory standard measure of risk with expected shortfall (ES) undertaken by the Basel Committee on Banking Supervision, it is imperative that ES gives correct estimates for the value of expected...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
3 Citations
2,748 Views
13 Pages

7 December 2019

Cross-efficiency evaluation is an effective methodology for discriminating among a set of decision-making units (DMUs) through both self- and peer-evaluation methods. This evaluation technique is usually used for data envelopment analysis (DEA) model...

  • Article
  • Open Access
10 Citations
3,082 Views
13 Pages

6 December 2019

We consider heat conduction in a superlattice with mobile defects, which reduce the thermal conductivity of the material. If the defects may be dragged by the heat flux, and if they are stopped at the interfaces of the superlattice, it is seen that t...

(This article belongs to the Special Issue Selected Papers from 15th Joint European Thermodynamics Conference)
  • Article
  • Open Access
6 Citations
5,978 Views
15 Pages

6 December 2019

The entropy rate h of a natural language quantifies the complexity underlying the language. While recent studies have used computational approaches to estimate this rate, their results rely fundamentally on the performance of the language model used...

(This article belongs to the Special Issue Information Theory and Language)
  • Article
  • Open Access
4 Citations
3,577 Views
15 Pages

6 December 2019

The size of the largest binary single deletion code has been unknown for more than 50 years. It is known that Varshamov–Tenengolts (VT) code is an optimum single deletion code for block length n ≤ 10 ; however, only a few upper bounds...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
2 Citations
2,675 Views
11 Pages

The Eigenvalue Complexity of Sequences in the Real Domain

  • Lingfeng Liu,
  • Hongyue Xiang,
  • Renzhi Li and
  • Hanping Hu

5 December 2019

The eigenvalue is one of the important cryptographic complexity measures for sequences. However, the eigenvalue can only evaluate sequences with finite symbols—it is not applicable for real number sequences. Recently, chaos-based cryptography h...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
21 Citations
5,631 Views
24 Pages

5 December 2019

Key concepts: We review interdependence theory measured by entropic forces, findings in support, and several examples from the field to advance a science of autonomous human-machine teams (A-HMTs) with artificial intelligence (AI). While theory is ne...

  • Article
  • Open Access
9 Citations
5,737 Views
18 Pages

A Survey on Using Kolmogorov Complexity in Cybersecurity

  • João S. Resende,
  • Rolando Martins and
  • Luís Antunes

5 December 2019

Security and privacy concerns are challenging the way users interact with devices. The number of devices connected to a home or enterprise network increases every day. Nowadays, the security of information systems is relevant as user information is c...

(This article belongs to the Special Issue Shannon Information and Kolmogorov Complexity)
  • Article
  • Open Access
18 Citations
5,925 Views
12 Pages

5 December 2019

Low-temperature heat utilization can be applied to waste heat from industrial processes or renewable energy sources such as geothermal and ocean energy. The most common low-temperature waste-heat recovery technology is the organic Rankine cycle (ORC)...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
15 Citations
6,069 Views
24 Pages

5 December 2019

Integrated Information Theory proposes a measure of conscious activity ( Φ ), characterised as the irreducibility of a dynamical system to the sum of its components. Due to its computational cost, current versions of the theory (IIT 3.0) are...

(This article belongs to the Special Issue Integrated Information Theory)
  • Article
  • Open Access
114 Citations
10,196 Views
11 Pages

5 December 2019

The motor imagery-based brain-computer interface (BCI) using electroencephalography (EEG) has been receiving attention from neural engineering researchers and is being applied to various rehabilitation applications. However, the performance degradati...

(This article belongs to the Special Issue Entropy in Image Analysis II)
  • Article
  • Open Access
5 Citations
4,024 Views
14 Pages

Magnetotelluric Signal-Noise Separation Using IE-LZC and MP

  • Xian Zhang,
  • Diquan Li,
  • Jin Li,
  • Yong Li and ,
  • Jialin Wang,
  • Shanshan Liu and
  • Zhimin Xu
  • + 2 authors+ 0 author

4 December 2019

Eliminating noise signals of the magnetotelluric (MT) method is bound to improve the quality of MT data. However, existing de-noising methods are designed for use in whole MT data sets, causing the loss of low-frequency information and severe mutatio...

(This article belongs to the Special Issue Shannon Information and Kolmogorov Complexity)
  • Article
  • Open Access
6 Citations
5,026 Views
15 Pages

4 December 2019

With the continuous development of data mining techniques in the medical field, variance analysis in clinical pathways based on data mining approaches have attracted increasing attention from scholars and decision makers. However, studies on variance...

(This article belongs to the Special Issue Information Theory and Complexity Science Approaches to Health Conditions and Cognitive Decline)
  • Article
  • Open Access
3 Citations
3,109 Views
19 Pages

Low-Element Image Restoration Based on an Out-of-Order Elimination Algorithm

  • Yaqin Xie,
  • Jiayin Yu,
  • Xinwu Chen,
  • Qun Ding and
  • Erfu Wang

4 December 2019

To reduce the consumption of receiving devices, a number of devices at the receiving end undergo low-element treatment (the number of devices at the receiving end is less than that at the transmitting ends). The underdetermined blind-source separatio...

(This article belongs to the Special Issue Nonlinear Dynamics and Entropy of Complex Systems with Hidden and Self-Excited Attractors II)
  • Article
  • Open Access
13 Citations
3,798 Views
18 Pages

4 December 2019

Condition-based maintenance (CBM) is a promising technique for a wide variety of deteriorating systems. Condition-based maintenance’s effectiveness largely depends on the quality of condition monitoring. The majority of CBM mathematical models...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
3 Citations
4,683 Views
12 Pages

3 December 2019

Following on from two previous JETC (Joint European Thermodynamics Conference) presentations, we present a preliminary report of further advances towards the thermodynamic description of critical behavior and a supercritical gas-liquid coexistence wi...

(This article belongs to the Special Issue Selected Papers from 15th Joint European Thermodynamics Conference)
  • Article
  • Open Access
15 Citations
7,662 Views
22 Pages

2 December 2019

Most of time series deriving from complex systems in real life is non-stationary, where the data distribution would be influenced by various internal/external factors such that the contexts are persistently changing. Therefore, the concept drift dete...

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300