Skip Content
You are currently on the new version of our website. Access the old version .

Entropy, Volume 21, Issue 12

2019 December - 105 articles

Cover Story: The information bottleneck (IB) method is a technique for extracting information in one random variable that is relevant for predicting another random variable. IB has applications in many fields, including machine learning with neural networks. In order to perform IB, however, one must find an optimally-compressed "bottleneck" random variable, which involves solving a difficult optimization problem with an information-theoretic objective function. We propose a method for solving this optimization problem using neural networks and a recently proposed bound on mutual information. We demonstrate that our approach exhibits better performance than other recent proposals. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (105)

  • Review
  • Open Access
23 Citations
11,569 Views
21 Pages

17 December 2019

Consciousness is a central issue in neuroscience, however, we still lack a formal framework that can address the nature of the relationship between consciousness and its physical substrates. In this review, we provide a novel mathematical framework o...

  • Article
  • Open Access
4,411 Views
19 Pages

A Quantum Cellular Automata Type Architecture with Quantum Teleportation for Quantum Computing

  • Dimitrios Ntalaperas,
  • Konstantinos Giannakis and
  • Nikos Konofaos

17 December 2019

We propose an architecture based on Quantum Cellular Automata which allows the use of only one type of quantum gate per computational step, using nearest neighbor interactions. The model is built in partial steps, each one of them analyzed using near...

  • Article
  • Open Access
23 Citations
6,006 Views
13 Pages

17 December 2019

Inspired by the possibility that generative models based on quantum circuits can provide a useful inductive bias for sequence modeling tasks, we propose an efficient training algorithm for a subset of classically simulable quantum circuit models. The...

  • Article
  • Open Access
8 Citations
4,534 Views
16 Pages

Multi-Type Node Detection in Network Communities

  • Chinenye Ezeh,
  • Ren Tao,
  • Li Zhe,
  • Wang Yiqun and
  • Qu Ying

17 December 2019

Patterns of connectivity among nodes on networks can be revealed by community detection algorithms. The great significance of communities in the study of clustering patterns of nodes in different systems has led to the development of various methods...

  • Feature Paper
  • Article
  • Open Access
12 Citations
4,070 Views
16 Pages

16 December 2019

Failure Mode, Effects and Criticality Analysis (FMECA) is a method which involves quantitative failure analysis. It systematically examines potential failure modes in a system, as well as the components of the system, to determine the impact of a fai...

  • Article
  • Open Access
97 Citations
5,954 Views
20 Pages

A New Approach to Fuzzy TOPSIS Method Based on Entropy Measure under Spherical Fuzzy Information

  • Omar Barukab,
  • Saleem Abdullah,
  • Shahzaib Ashraf,
  • Muhammad Arif and
  • Sher Afzal Khan

16 December 2019

Spherical fuzzy set (SFS) is one of the most important and extensive concept to accommodate more uncertainties than existing fuzzy set structures. In this article, we will describe a novel enhanced TOPSIS-based procedure for tackling multi attribute...

  • Article
  • Open Access
34 Citations
4,363 Views
13 Pages

16 December 2019

Nowadays the importance of thermomechanical engines is recognized worldwide. Since the industrial revolution, physicists and engineers have sought to maximize the efficiency of these machines, but also the mechanical energy or the power output of the...

  • Article
  • Open Access
26 Citations
5,631 Views
16 Pages

Detecting Causality in Multivariate Time Series via Non-Uniform Embedding

  • Ziyu Jia,
  • Youfang Lin,
  • Zehui Jiao,
  • Yan Ma and
  • Jing Wang

16 December 2019

Causal analysis based on non-uniform embedding schemes is an important way to detect the underlying interactions between dynamic systems. However, there are still some obstacles to estimating high-dimensional conditional mutual information and formin...

  • Article
  • Open Access
27 Citations
3,513 Views
16 Pages

Entropy Generation and Heat Transfer in Drilling Nanoliquids with Clay Nanoparticles

  • Kottakkaran Sooppy Nisar,
  • Dolat Khan,
  • Arshad Khan,
  • Waqar A Khan,
  • Ilyas Khan and
  • Abdullah Mohammed Aldawsari

16 December 2019

Different types of nanomaterials are used these days. Among them, clay nanoparticles are the one of the most applicable and affordable options. Specifically, clay nanoparticles have numerous applications in the field of medical science for cleaning b...

  • Article
  • Open Access
21 Citations
5,706 Views
16 Pages

Convolutional Recurrent Neural Networks with a Self-Attention Mechanism for Personnel Performance Prediction

  • Xia Xue,
  • Jun Feng,
  • Yi Gao,
  • Meng Liu,
  • Wenyu Zhang,
  • Xia Sun,
  • Aiqi Zhao and
  • Shouxi Guo

16 December 2019

Personnel performance is important for the high-technology industry to ensure its core competitive advantages are present. Therefore, predicting personnel performance is an important research area in human resource management (HRM). In this paper, to...

  • Article
  • Open Access
7 Citations
5,020 Views
25 Pages

16 December 2019

Individuals’ ability to express their subjective experiences in terms of such attributes as pleasant/unpleasant or positive/negative feelings forms a fundamental property of their affect and emotion. However, neuroscientific findings on the und...

  • Article
  • Open Access
12 Citations
4,459 Views
16 Pages

Digital Volume Pulse Measured at the Fingertip as an Indicator of Diabetic Peripheral Neuropathy in the Aged and Diabetic

  • Hai-Cheng Wei,
  • Na Ta,
  • Wen-Rui Hu,
  • Ming-Xia Xiao,
  • Xiao-Jing Tang,
  • Bagus Haryadi,
  • Juin J. Liou and
  • Hsien-Tsai Wu

16 December 2019

This study investigated the application of a modified percussion entropy index (PEIPPI) in assessing the complexity of baroreflex sensitivity (BRS) for diabetic peripheral neuropathy prognosis. The index was acquired by comparing the obedience of the...

  • Article
  • Open Access
21 Citations
4,954 Views
21 Pages

Information Theory for Non-Stationary Processes with Stationary Increments

  • Carlos Granero-Belinchón,
  • Stéphane G. Roux and
  • Nicolas B. Garnier

15 December 2019

We describe how to analyze the wide class of non-stationary processes with stationary centered increments using Shannon information theory. To do so, we use a practical viewpoint and define ersatz quantities from time-averaged probability distributio...

  • Article
  • Open Access
7 Citations
3,835 Views
15 Pages

15 December 2019

Stays at high altitude induce alterations in cardiovascular control and are a model of specific pathological cardiovascular derangements at sea level. However, high-altitude alterations of the complex cardiovascular dynamics remain an almost unexplor...

  • Article
  • Open Access
2 Citations
3,148 Views
9 Pages

A Comparative Study of Geoelectric Signals Possibly Associated with the Occurrence of Two Ms > 7 EQs in the South Pacific Coast of Mexico

  • Lev Guzmán-Vargas,
  • Carlos Carrizales-Velazquez,
  • Israel Reyes-Ramírez,
  • Jorge Fonseca-Campos,
  • Arturo de la Rosa-Galindo,
  • Víctor O. Quintana-Moreno,
  • José Antonio Peralta and
  • Fernando Angulo-Brown

15 December 2019

During past decades, several studies have suggested the existence of possible seismic electric precursors associated with earthquakes of magnitude M > 7 . However, additional analyses are needed to have more reliable evidence of pattern beh...

  • Article
  • Open Access
32 Citations
5,243 Views
10 Pages

Permutation Entropy and Statistical Complexity Analysis of Brazilian Agricultural Commodities

  • Fernando Henrique Antunes de Araujo,
  • Lucian Bejan,
  • Osvaldo A. Rosso and
  • Tatijana Stosic

14 December 2019

Agricultural commodities are considered perhaps the most important commodities, as any abrupt increase in food prices has serious consequences on food security and welfare, especially in developing countries. In this work, we analyze predictability o...

  • Article
  • Open Access
10 Citations
4,301 Views
14 Pages

14 December 2019

The purpose of this study is to introduce an improved Luedeking–Piret model that represents a structurally simple biomass concentration approach. The developed routine provides acceptable accuracy when fitting experimental data that incorporate...

  • Article
  • Open Access
66 Citations
9,737 Views
24 Pages

14 December 2019

Deep Learning (DL) and Artificial Intelligence (AI) tools have shown great success in different areas of medical diagnostics. In this paper, we show another success in orthodontics. In orthodontics, the right treatment timing of many actions and oper...

  • Article
  • Open Access
48 Citations
9,155 Views
31 Pages

Ordering of Trotterization: Impact on Errors in Quantum Simulation of Electronic Structure

  • Andrew Tranter,
  • Peter J. Love,
  • Florian Mintert,
  • Nathan Wiebe and
  • Peter V. Coveney

13 December 2019

Trotter–Suzuki decompositions are frequently used in the quantum simulation of quantum chemistry. They transform the evolution operator into a form implementable on a quantum device, while incurring an error—the Trotter error. The Trotter...

  • Article
  • Open Access
11 Citations
4,043 Views
40 Pages

13 December 2019

Using a Lyapunov type functional constructed on the basis of thermodynamical arguments, we investigate the finite amplitude stability of internal steady flows of viscoelastic fluids described by the Giesekus model. Using the functional, we derive bou...

  • Article
  • Open Access
32 Citations
3,608 Views
17 Pages

12 December 2019

Ship-radiated noise signal has a lot of nonlinear, non-Gaussian, and nonstationary information characteristics, which can reflect the important signs of ship performance. This paper proposes a novel feature extraction technique for ship-radiated nois...

  • Article
  • Open Access
22 Citations
4,920 Views
16 Pages

12 December 2019

Massive open online courses (MOOCs), which have been deemed a revolutionary teaching mode, are increasingly being used in higher education. However, there remain deficiencies in understanding the relationship between online behavior of students and t...

  • Article
  • Open Access
7 Citations
5,317 Views
9 Pages

11 December 2019

Synthetic data has been shown to be effective in training state-of-the-art neural machine translation (NMT) systems. Because the synthetic data is often generated by back-translating monolingual data from the target language into the source language,...

  • Article
  • Open Access
6 Citations
3,988 Views
20 Pages

A Two Phase Method for Solving the Distribution Problem in a Fuzzy Setting

  • Krzysztof Kaczmarek,
  • Ludmila Dymova and
  • Pavel Sevastjanov

11 December 2019

In this paper, a new method for the solution of distribution problem in a fuzzy setting is presented. It consists of two phases. In the first of them, the problem is formulated as the classical, fully fuzzy transportation problem. A new, straightforw...

  • Article
  • Open Access
3 Citations
3,045 Views
19 Pages

Learning from Both Experts and Data

  • Rémi Besson,
  • Erwan Le Pennec and
  • Stéphanie Allassonnière

10 December 2019

In this work, we study the problem of inferring a discrete probability distribution using both expert knowledge and empirical data. This is an important issue for many applications where the scarcity of data prevents a purely empirical approach. In t...

  • Article
  • Open Access
20 Citations
3,882 Views
21 Pages

10 December 2019

Entropy is an uncertainty measure of random variables which mathematically represents the prospective quantity of the information. In this paper, we mainly focus on the estimation for the parameters and entropy of an Inverse Weibull distribution unde...

  • Article
  • Open Access
4 Citations
3,501 Views
10 Pages

The Static Standing Postural Stability Measured by Average Entropy

  • Sung-Yang Wei,
  • Chang Francis Hsu,
  • Yun-Ju Lee,
  • Long Hsu and
  • Sien Chi

10 December 2019

Static standing postural stability has been measured by multiscale entropy (MSE), which is used to measure complexity. In this study, we used the average entropy (AE) to measure the static standing postural stability, as AE is a good measure of disor...

  • Article
  • Open Access
38 Citations
10,389 Views
18 Pages

On the Statistical Mechanics of Life: Schrödinger Revisited

  • Kate Jeffery,
  • Robert Pollack and
  • Carlo Rovelli

10 December 2019

We study the statistical underpinnings of life, in particular its increase in order and complexity over evolutionary time. We question some common assumptions about the thermodynamics of life. We recall that contrary to widespread belief, even in a c...

  • Article
  • Open Access
2 Citations
3,639 Views
27 Pages

Dissipation in Non-Steady State Regulatory Circuits

  • Paulina Szymańska-Rożek,
  • Dario Villamaina,
  • Jacek Miȩkisz and
  • Aleksandra M. Walczak

10 December 2019

In order to respond to environmental signals, cells often use small molecular circuits to transmit information about their surroundings. Recently, motivated by specific examples in signaling and gene regulation, a body of work has focused on the prop...

  • Article
  • Open Access
5 Citations
3,821 Views
22 Pages

9 December 2019

Costa et. al (Frontiers in Physiology (2017) 8255) proved that abnormal features of heart rate variability (HRV) can be discerned by the presence of particular patterns in a signal of time intervals between subsequent heart contractions, called RR in...

  • Article
  • Open Access
5 Citations
2,804 Views
14 Pages

9 December 2019

The high fidelity generation of strongly entangled states of many particles, such as cat states, is a particularly demanding challenge. One approach is to drive the system, within a certain final time, as adiabatically as possible, in order to avoid...

  • Feature Paper
  • Article
  • Open Access
26 Citations
4,451 Views
17 Pages

A Portable Wireless Device for Cyclic Alternating Pattern Estimation from an EEG Monopolar Derivation

  • Fábio Mendonça,
  • Sheikh Shanawaz Mostafa,
  • Fernando Morgado-Dias and
  • Antonio G. Ravelo-García

7 December 2019

Quality of sleep can be assessed by analyzing the cyclic alternating pattern, a long-lasting periodic activity that is composed of two alternate electroencephalogram patterns, which is considered to be a marker of sleep instability. Experts usually s...

  • Article
  • Open Access
3 Citations
4,165 Views
19 Pages

Modeling Expected Shortfall Using Tail Entropy

  • Daniel Traian Pele,
  • Emese Lazar and
  • Miruna Mazurencu-Marinescu-Pele

7 December 2019

Given the recent replacement of value-at-risk as the regulatory standard measure of risk with expected shortfall (ES) undertaken by the Basel Committee on Banking Supervision, it is imperative that ES gives correct estimates for the value of expected...

  • Article
  • Open Access
3 Citations
2,510 Views
13 Pages

7 December 2019

Cross-efficiency evaluation is an effective methodology for discriminating among a set of decision-making units (DMUs) through both self- and peer-evaluation methods. This evaluation technique is usually used for data envelopment analysis (DEA) model...

  • Article
  • Open Access
9 Citations
2,860 Views
13 Pages

6 December 2019

We consider heat conduction in a superlattice with mobile defects, which reduce the thermal conductivity of the material. If the defects may be dragged by the heat flux, and if they are stopped at the interfaces of the superlattice, it is seen that t...

  • Article
  • Open Access
6 Citations
5,225 Views
15 Pages

6 December 2019

The entropy rate h of a natural language quantifies the complexity underlying the language. While recent studies have used computational approaches to estimate this rate, their results rely fundamentally on the performance of the language model used...

  • Article
  • Open Access
4 Citations
3,150 Views
15 Pages

6 December 2019

The size of the largest binary single deletion code has been unknown for more than 50 years. It is known that Varshamov–Tenengolts (VT) code is an optimum single deletion code for block length n 10 ; however, only a few upper bounds...

  • Article
  • Open Access
2 Citations
2,460 Views
11 Pages

The Eigenvalue Complexity of Sequences in the Real Domain

  • Lingfeng Liu,
  • Hongyue Xiang,
  • Renzhi Li and
  • Hanping Hu

5 December 2019

The eigenvalue is one of the important cryptographic complexity measures for sequences. However, the eigenvalue can only evaluate sequences with finite symbols—it is not applicable for real number sequences. Recently, chaos-based cryptography h...

  • Article
  • Open Access
18 Citations
4,917 Views
24 Pages

5 December 2019

Key concepts: We review interdependence theory measured by entropic forces, findings in support, and several examples from the field to advance a science of autonomous human-machine teams (A-HMTs) with artificial intelligence (AI). While theory is ne...

  • Article
  • Open Access
9 Citations
5,273 Views
18 Pages

A Survey on Using Kolmogorov Complexity in Cybersecurity

  • João S. Resende,
  • Rolando Martins and
  • Luís Antunes

5 December 2019

Security and privacy concerns are challenging the way users interact with devices. The number of devices connected to a home or enterprise network increases every day. Nowadays, the security of information systems is relevant as user information is c...

  • Article
  • Open Access
16 Citations
5,347 Views
12 Pages

5 December 2019

Low-temperature heat utilization can be applied to waste heat from industrial processes or renewable energy sources such as geothermal and ocean energy. The most common low-temperature waste-heat recovery technology is the organic Rankine cycle (ORC)...

  • Article
  • Open Access
15 Citations
5,343 Views
24 Pages

5 December 2019

Integrated Information Theory proposes a measure of conscious activity ( Φ ), characterised as the irreducibility of a dynamical system to the sum of its components. Due to its computational cost, current versions of the theory (IIT 3.0) are...

  • Article
  • Open Access
104 Citations
9,604 Views
11 Pages

5 December 2019

The motor imagery-based brain-computer interface (BCI) using electroencephalography (EEG) has been receiving attention from neural engineering researchers and is being applied to various rehabilitation applications. However, the performance degradati...

  • Article
  • Open Access
3 Citations
3,699 Views
14 Pages

Magnetotelluric Signal-Noise Separation Using IE-LZC and MP

  • Xian Zhang,
  • Diquan Li,
  • Jin Li,
  • Yong Li,
  • Jialin Wang,
  • Shanshan Liu and
  • Zhimin Xu

4 December 2019

Eliminating noise signals of the magnetotelluric (MT) method is bound to improve the quality of MT data. However, existing de-noising methods are designed for use in whole MT data sets, causing the loss of low-frequency information and severe mutatio...

  • Article
  • Open Access
5 Citations
4,614 Views
15 Pages

4 December 2019

With the continuous development of data mining techniques in the medical field, variance analysis in clinical pathways based on data mining approaches have attracted increasing attention from scholars and decision makers. However, studies on variance...

  • Article
  • Open Access
3 Citations
2,808 Views
19 Pages

Low-Element Image Restoration Based on an Out-of-Order Elimination Algorithm

  • Yaqin Xie,
  • Jiayin Yu,
  • Xinwu Chen,
  • Qun Ding and
  • Erfu Wang

4 December 2019

To reduce the consumption of receiving devices, a number of devices at the receiving end undergo low-element treatment (the number of devices at the receiving end is less than that at the transmitting ends). The underdetermined blind-source separatio...

  • Article
  • Open Access
13 Citations
3,504 Views
18 Pages

4 December 2019

Condition-based maintenance (CBM) is a promising technique for a wide variety of deteriorating systems. Condition-based maintenance’s effectiveness largely depends on the quality of condition monitoring. The majority of CBM mathematical models...

  • Article
  • Open Access
3 Citations
4,286 Views
12 Pages

3 December 2019

Following on from two previous JETC (Joint European Thermodynamics Conference) presentations, we present a preliminary report of further advances towards the thermodynamic description of critical behavior and a supercritical gas-liquid coexistence wi...

  • Article
  • Open Access
13 Citations
7,045 Views
22 Pages

2 December 2019

Most of time series deriving from complex systems in real life is non-stationary, where the data distribution would be influenced by various internal/external factors such that the contexts are persistently changing. Therefore, the concept drift dete...

of 3

Get Alerted

Add your email address to receive forthcoming issues of this journal.

XFacebookLinkedIn
Entropy - ISSN 1099-4300