You are currently viewing a new version of our website. To view the old version click .

Entropy, Volume 26, Issue 5

May 2024 - 83 articles

Cover Story: Information theory has found applications in diverse disciplines due to its solid foundation in probability theory. However, data often doesn’t follow specific probability distributions, complicating direct applications of information-theoretic concepts. Non-parametric methods can estimate these quantities from data, but which existing method is best? We evaluated different estimation methods practically by measuring the relative error of their estimates across different uni- and multivariate distributions and sample sizes. We also considered each estimator’s hyperparameters and implementation challenges. Through synthetic case studies, we show the behavior of different methods and highlight the advantages of nearest neighbor-based estimation. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (83)

  • Article
  • Open Access
4 Citations
1,704 Views
14 Pages

20 May 2024

Taking into account the complexity of the human brain dynamics, the appropriate characterization of any brain state is a challenge not easily met. Actually, even the discrimination of simple behavioral tasks, such as resting with eyes closed or eyes...

  • Article
  • Open Access
8 Citations
1,784 Views
19 Pages

AM-MSFF: A Pest Recognition Network Based on Attention Mechanism and Multi-Scale Feature Fusion

  • Meng Zhang,
  • Wenzhong Yang,
  • Danny Chen,
  • Chenghao Fu and
  • Fuyuan Wei

20 May 2024

Traditional methods for pest recognition have certain limitations in addressing the challenges posed by diverse pest species, varying sizes, diverse morphologies, and complex field backgrounds, resulting in a lower recognition accuracy. To overcome t...

  • Review
  • Open Access
4 Citations
3,511 Views
12 Pages

18 May 2024

Mainstream research on information theory within the field of living systems involves the application of analytical tools to understand a broad range of life processes. This paper is dedicated to an opposite problem: it explores the information theor...

  • Feature Paper
  • Article
  • Open Access
5 Citations
2,370 Views
8 Pages

Heat Bath in a Quantum Circuit

  • Jukka P. Pekola and
  • Bayan Karimi

17 May 2024

We discuss the concept and realization of a heat bath in solid state quantum systems. We demonstrate that, unlike a true resistor, a finite one-dimensional Josephson junction array or analogously a transmission line with non-vanishing frequency spaci...

  • Article
  • Open Access
2 Citations
2,082 Views
15 Pages

16 May 2024

Ensuring the safe and stable operation of high-speed trains necessitates real-time monitoring and diagnostics of their suspension systems. While machine learning technology is widely employed for industrial equipment fault diagnosis, its effective ap...

  • Article
  • Open Access
5 Citations
1,560 Views
18 Pages

16 May 2024

Addressing the challenges posed by the complexity of the structure and the multitude of sensor types installed in space application fluid loop systems, this paper proposes a fault diagnosis method based on an improved D-S evidence theory. The method...

  • Article
  • Open Access
2 Citations
2,294 Views
20 Pages

Exploring Simplicity Bias in 1D Dynamical Systems

  • Kamal Dingle,
  • Mohammad Alaskandarani,
  • Boumediene Hamzi and
  • Ard A. Louis

16 May 2024

Arguments inspired by algorithmic information theory predict an inverse relation between the probability and complexity of output patterns in a wide range of input–output maps. This phenomenon is known as simplicity bias. By viewing the paramet...

  • Feature Paper
  • Article
  • Open Access
5 Citations
2,201 Views
10 Pages

Memory Corrections to Markovian Langevin Dynamics

  • Mateusz Wiśniewski,
  • Jerzy Łuczka and
  • Jakub Spiechowicz

16 May 2024

Analysis of non-Markovian systems and memory-induced phenomena poses an everlasting challenge in the realm of physics. As a paradigmatic example, we consider a classical Brownian particle of mass M subjected to an external force and exposed to correl...

  • Feature Paper
  • Article
  • Open Access
5 Citations
3,292 Views
50 Pages

15 May 2024

Partial information decompositions (PIDs) aim to categorize how a set of source variables provides information about a target variable redundantly, uniquely, or synergetically. The original proposal for such an analysis used a lattice-based approach...

  • Article
  • Open Access
11 Citations
8,066 Views
18 Pages

15 May 2024

The physical roots, interpretation, controversies, and precise meaning of the Landauer principle are surveyed. The Landauer principle is a physical principle defining the lower theoretical limit of energy consumption necessary for computation. It sta...

of 9

Get Alerted

Add your email address to receive forthcoming issues of this journal.

XFacebookLinkedIn
Entropy - ISSN 1099-4300