Skip to Content

Entropy, Volume 26, Issue 5

2024 May - 83 articles

Cover Story: Information theory has found applications in diverse disciplines due to its solid foundation in probability theory. However, data often doesn’t follow specific probability distributions, complicating direct applications of information-theoretic concepts. Non-parametric methods can estimate these quantities from data, but which existing method is best? We evaluated different estimation methods practically by measuring the relative error of their estimates across different uni- and multivariate distributions and sample sizes. We also considered each estimator’s hyperparameters and implementation challenges. Through synthetic case studies, we show the behavior of different methods and highlight the advantages of nearest neighbor-based estimation. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (83)

  • Article
  • Open Access
4 Citations
1,811 Views
14 Pages

20 May 2024

Taking into account the complexity of the human brain dynamics, the appropriate characterization of any brain state is a challenge not easily met. Actually, even the discrimination of simple behavioral tasks, such as resting with eyes closed or eyes...

  • Article
  • Open Access
9 Citations
1,978 Views
19 Pages

AM-MSFF: A Pest Recognition Network Based on Attention Mechanism and Multi-Scale Feature Fusion

  • Meng Zhang,
  • Wenzhong Yang,
  • Danny Chen,
  • Chenghao Fu and
  • Fuyuan Wei

20 May 2024

Traditional methods for pest recognition have certain limitations in addressing the challenges posed by diverse pest species, varying sizes, diverse morphologies, and complex field backgrounds, resulting in a lower recognition accuracy. To overcome t...

  • Review
  • Open Access
5 Citations
3,986 Views
12 Pages

18 May 2024

Mainstream research on information theory within the field of living systems involves the application of analytical tools to understand a broad range of life processes. This paper is dedicated to an opposite problem: it explores the information theor...

  • Feature Paper
  • Article
  • Open Access
6 Citations
2,612 Views
8 Pages

Heat Bath in a Quantum Circuit

  • Jukka P. Pekola and
  • Bayan Karimi

17 May 2024

We discuss the concept and realization of a heat bath in solid state quantum systems. We demonstrate that, unlike a true resistor, a finite one-dimensional Josephson junction array or analogously a transmission line with non-vanishing frequency spaci...

  • Article
  • Open Access
2 Citations
2,265 Views
15 Pages

16 May 2024

Ensuring the safe and stable operation of high-speed trains necessitates real-time monitoring and diagnostics of their suspension systems. While machine learning technology is widely employed for industrial equipment fault diagnosis, its effective ap...

  • Article
  • Open Access
5 Citations
1,714 Views
18 Pages

16 May 2024

Addressing the challenges posed by the complexity of the structure and the multitude of sensor types installed in space application fluid loop systems, this paper proposes a fault diagnosis method based on an improved D-S evidence theory. The method...

  • Article
  • Open Access
2 Citations
2,463 Views
20 Pages

Exploring Simplicity Bias in 1D Dynamical Systems

  • Kamal Dingle,
  • Mohammad Alaskandarani,
  • Boumediene Hamzi and
  • Ard A. Louis

16 May 2024

Arguments inspired by algorithmic information theory predict an inverse relation between the probability and complexity of output patterns in a wide range of input–output maps. This phenomenon is known as simplicity bias. By viewing the paramet...

  • Feature Paper
  • Article
  • Open Access
5 Citations
2,467 Views
10 Pages

Memory Corrections to Markovian Langevin Dynamics

  • Mateusz Wiśniewski,
  • Jerzy Łuczka and
  • Jakub Spiechowicz

16 May 2024

Analysis of non-Markovian systems and memory-induced phenomena poses an everlasting challenge in the realm of physics. As a paradigmatic example, we consider a classical Brownian particle of mass M subjected to an external force and exposed to correl...

  • Feature Paper
  • Article
  • Open Access
5 Citations
3,727 Views
50 Pages

15 May 2024

Partial information decompositions (PIDs) aim to categorize how a set of source variables provides information about a target variable redundantly, uniquely, or synergetically. The original proposal for such an analysis used a lattice-based approach...

  • Article
  • Open Access
11 Citations
8,911 Views
18 Pages

15 May 2024

The physical roots, interpretation, controversies, and precise meaning of the Landauer principle are surveyed. The Landauer principle is a physical principle defining the lower theoretical limit of energy consumption necessary for computation. It sta...

  • Article
  • Open Access
1 Citations
2,257 Views
16 Pages

Model Selection for Exponential Power Mixture Regression Models

  • Yunlu Jiang,
  • Jiangchuan Liu,
  • Hang Zou and
  • Xiaowen Huang

15 May 2024

Finite mixture of linear regression (FMLR) models are among the most exemplary statistical tools to deal with various heterogeneous data. In this paper, we introduce a new procedure to simultaneously determine the number of components and perform var...

  • Article
  • Open Access
3 Citations
2,249 Views
13 Pages

15 May 2024

In this paper, we consider a downlink non-orthogonal multiple access (NOMA) system over Nakagami-m channels. The single-antenna base station serves two single-antenna NOMA users based on statistical channel state information (CSI). We derive the clos...

  • Review
  • Open Access
3 Citations
2,407 Views
28 Pages

14 May 2024

One of the most important and unanswered problems in particle physics is the origin of the three generations of quarks and leptons. The Standard Model does not provide any hint regarding its sequential charge assignments, which remain a fundamental m...

  • Article
  • Open Access
7 Citations
2,690 Views
32 Pages

Capacity Analysis of Hybrid Satellite–Terrestrial Systems with Selection Relaying

  • Predrag Ivaniš,
  • Jovan Milojković,
  • Vesna Blagojević and
  • Srđan Brkić

13 May 2024

A hybrid satellite–terrestrial relay network is a simple and flexible solution that can be used to improve the performance of land mobile satellite systems, where the communication links between satellite and mobile terrestrial users can be uns...

  • Article
  • Open Access
6 Citations
3,082 Views
49 Pages

13 May 2024

This article reconsiders E. Schrödinger’s cat paradox experiment from a new perspective, grounded in the interpretation of quantum mechanics that belongs to the class of interpretations designated as “reality without realism” (...

  • Article
  • Open Access
1 Citations
2,308 Views
18 Pages

13 May 2024

The aging intensity (AI), defined as the ratio of the instantaneous hazard rate and a baseline hazard rate, is a useful tool for the describing reliability properties of a random variable corresponding to a lifetime. In this work, the concept of AI i...

  • Article
  • Open Access
2,692 Views
20 Pages

12 May 2024

In unstructured environments, robots need to deal with a wide variety of objects with diverse shapes, and often, the instances of these objects are unknown. Traditional methods rely on training with large-scale labeled data, but in environments with...

  • Feature Paper
  • Article
  • Open Access
3 Citations
2,808 Views
26 Pages

11 May 2024

In a dissipative regime, we study the properties of several qubits coupled to a driven resonator in the framework of a Jaynes–Cummings model. The time evolution and the steady state of the system are numerically analyzed within the Lindblad mas...

  • Feature Paper
  • Article
  • Open Access
2,291 Views
16 Pages

11 May 2024

Quantum tunneling in a two-dimensional integrable map is studied. The orbits of the map are all confined to the curves specified by the one-dimensional Hamiltonian. It is found that the behavior of tunneling splitting for the integrable map and the a...

  • Article
  • Open Access
16 Citations
2,474 Views
17 Pages

10 May 2024

Quantum private comparison (QPC) is a fundamental cryptographic protocol that allows two parties to compare the equality of their private inputs without revealing any information about those inputs to each other. In recent years, QPC protocols utiliz...

  • Article
  • Open Access
1 Citations
1,653 Views
15 Pages

10 May 2024

We apply the so-called variational Gaussian wavepacket approximation (VGA) for conducting both real- and imaginary-time dynamics to calculate thermal correlation functions. By considering strongly anharmonic systems, such as a quartic potential and a...

  • Article
  • Open Access
2 Citations
4,105 Views
21 Pages

8 May 2024

Quantum simulation qubit models of electronic Hamiltonians rely on specific transformations in order to take into account the fermionic permutation properties of electrons. These transformations (principally the Jordan–Wigner transformation (JW...

  • Article
  • Open Access
37 Citations
2,310 Views
17 Pages

8 May 2024

As one of the most vital energy conversation systems, the safe operation of wind turbines is very important; however, weak fault and time-varying speed may challenge the conventional monitoring strategies. Thus, an entropy-aided meshing-order modulat...

  • Article
  • Open Access
3 Citations
1,849 Views
25 Pages

Investigation of Thermo-Hydraulics in a Lid-Driven Square Cavity with a Heated Hemispherical Obstacle at the Bottom

  • Farhan Lafta Rashid,
  • Abbas Fadhil Khalaf,
  • Arman Ameen and
  • Mudhar A. Al-Obaidi

8 May 2024

Lid-driven cavity (LDC) flow is a significant area of study in fluid mechanics due to its common occurrence in engineering challenges. However, using numerical simulations (ANSYS Fluent) to accurately predict fluid flow and mixed convective heat tran...

  • Article
  • Open Access
1,896 Views
18 Pages

8 May 2024

This paper studies the problem of minimizing the total cost, including computation cost and communication cost, in the system of two-sided secure distributed matrix multiplication (SDMM) under an arbitrary collusion pattern. In order to perform SDMM,...

  • Article
  • Open Access
2,217 Views
9 Pages

Chaos Synchronization of Integrated Five-Section Semiconductor Lasers

  • Yuanyuan Guo,
  • Yao Du,
  • Hua Gao,
  • Min Tan,
  • Tong Zhao,
  • Zhiwei Jia,
  • Pengfa Chang and
  • Longsheng Wang

6 May 2024

We proposed and verified a scheme of chaos synchronization for integrated five-section semiconductor lasers with matching parameters. The simulation results demonstrated that the integrated five-section semiconductor laser could generate a chaotic si...

  • Article
  • Open Access
2 Citations
2,453 Views
32 Pages

Importance of Characteristic Features and Their Form for Data Exploration

  • Urszula Stańczyk,
  • Beata Zielosko and
  • Grzegorz Baron

6 May 2024

The nature of the input features is one of the key factors indicating what kind of tools, methods, or approaches can be used in a knowledge discovery process. Depending on the characteristics of the available attributes, some techniques could lead to...

  • Article
  • Open Access
4 Citations
3,412 Views
21 Pages

A Novel Classification Method: Neighborhood-Based Positive Unlabeled Learning Using Decision Tree (NPULUD)

  • Bita Ghasemkhani,
  • Kadriye Filiz Balbal,
  • Kokten Ulas Birant and
  • Derya Birant

4 May 2024

In a standard binary supervised classification task, the existence of both negative and positive samples in the training dataset are required to construct a classification model. However, this condition is not met in certain applications where only o...

  • Article
  • Open Access
4 Citations
2,918 Views
17 Pages

4 May 2024

Due to various reasons, such as limitations in data collection and interruptions in network transmission, gathered data often contain missing values. Existing state-of-the-art generative adversarial imputation methods face three main issues: limited...

  • Feature Paper
  • Review
  • Open Access
16 Citations
4,605 Views
137 Pages

Monte Carlo Based Techniques for Quantum Magnets with Long-Range Interactions

  • Patrick Adelhardt,
  • Jan A. Koziol,
  • Anja Langheld and
  • Kai P. Schmidt

1 May 2024

Long-range interactions are relevant for a large variety of quantum systems in quantum optics and condensed matter physics. In particular, the control of quantum–optical platforms promises to gain deep insights into quantum-critical properties...

  • Article
  • Open Access
5 Citations
2,968 Views
16 Pages

1 May 2024

Medical image diagnosis using deep learning has shown significant promise in clinical medicine. However, it often encounters two major difficulties in real-world applications: (1) domain shift, which invalidates the trained model on new datasets, and...

  • Review
  • Open Access
3,392 Views
45 Pages

30 April 2024

The common geometrical (symplectic) structures of classical mechanics, quantum mechanics, and classical thermodynamics are unveiled with three pictures. These cardinal theories, mainly at the non-relativistic approximation, are the cornerstones for s...

  • Article
  • Open Access
2 Citations
4,617 Views
15 Pages

QUBO Problem Formulation of Fragment-Based Protein–Ligand Flexible Docking

  • Keisuke Yanagisawa,
  • Takuya Fujie,
  • Kazuki Takabatake and
  • Yutaka Akiyama

30 April 2024

Protein–ligand docking plays a significant role in structure-based drug discovery. This methodology aims to estimate the binding mode and binding free energy between the drug-targeted protein and candidate chemical compounds, utilizing protein...

  • Article
  • Open Access
2 Citations
2,580 Views
21 Pages

30 April 2024

This article introduces an analytical framework that interprets individual measures of entropy-based mobility derived from mobile phone data. We explore and analyze two widely recognized entropy metrics: random entropy and uncorrelated Shannon entrop...

  • Article
  • Open Access
1 Citations
1,943 Views
19 Pages

30 April 2024

In this paper, we apply a machine-learning approach to learn traveling solitary waves across various physical systems that are described by families of partial differential equations (PDEs). Our approach integrates a novel interpretable neural networ...

  • Feature Paper
  • Article
  • Open Access
1 Citations
1,633 Views
25 Pages

30 April 2024

Random matrix theory, particularly using matrices akin to the Wishart ensemble, has proven successful in elucidating the thermodynamic characteristics of critical behavior in spin systems across varying interaction ranges. This paper explores the app...

  • Feature Paper
  • Article
  • Open Access
32 Citations
7,211 Views
22 Pages

A Joint Communication and Computation Design for Probabilistic Semantic Communications

  • Zhouxiang Zhao,
  • Zhaohui Yang,
  • Mingzhe Chen,
  • Zhaoyang Zhang and
  • H. Vincent Poor

30 April 2024

In this paper, the problem of joint transmission and computation resource allocation for a multi-user probabilistic semantic communication (PSC) network is investigated. In the considered model, users employ semantic information extraction techniques...

  • Article
  • Open Access
1 Citations
2,117 Views
22 Pages

30 April 2024

This paper develops a thermodynamic entropy-based life prediction model to estimate the low-cycle fatigue (LCF) life of the nickel-based superalloy GH4169 at elevated temperature (650 °C). The gauge section of the specimen was chosen as the therm...

  • Article
  • Open Access
1 Citations
2,906 Views
24 Pages

30 April 2024

Underwriters play a pivotal role in the IPO process. Information entropy, a tool for measuring the uncertainty and complexity of information, has been widely applied to various issues in complex networks. Information entropy can quantify the uncertai...

  • Article
  • Open Access
8 Citations
3,293 Views
13 Pages

Lévy Flight Model of Gaze Trajectories to Assist in ADHD Diagnoses

  • Christos Papanikolaou,
  • Akriti Sharma,
  • Pedro G. Lind and
  • Pedro Lencastre

30 April 2024

The precise mathematical description of gaze patterns remains a topic of ongoing debate, impacting the practical analysis of eye-tracking data. In this context, we present evidence supporting the appropriateness of a Lévy flight description fo...

  • Feature Paper
  • Article
  • Open Access
22 Citations
3,289 Views
33 Pages

30 April 2024

We build on the view of the Exact Renormalization Group (ERG) as an instantiation of Optimal Transport described by a functional convection–diffusion equation. We provide a new information-theoretic perspective for understanding the ERG through...

  • Article
  • Open Access
1 Citations
2,176 Views
19 Pages

30 April 2024

Traffic state classification and relevance calculation at intersections are both difficult problems in traffic control. In this paper, we propose an intersection relevance model based on a temporal graph attention network, which can solve the above t...

  • Feature Paper
  • Article
  • Open Access
8 Citations
3,407 Views
34 Pages

On the Accurate Estimation of Information-Theoretic Quantities from Multi-Dimensional Sample Data

  • Manuel Álvarez Chaves,
  • Hoshin V. Gupta,
  • Uwe Ehret and
  • Anneli Guthke

30 April 2024

Using information-theoretic quantities in practical applications with continuous data is often hindered by the fact that probability density functions need to be estimated in higher dimensions, which can become unreliable or even computationally unfe...

  • Article
  • Open Access
2,121 Views
27 Pages

30 April 2024

Spatiotemporal information on individual trajectories in urban rail transit is important for operational strategy adjustment, personalized recommendation, and emergency command decision-making. However, due to the lack of journey observations, it is...

  • Article
  • Open Access
1,532 Views
22 Pages

30 April 2024

The focus of our research is the examination of Hermitian curves over finite fields, specifically concentrating on places of degree three and their role in constructing Hermitian codes. We begin by studying the structure of the Riemann–Roch spa...

  • Article
  • Open Access
24 Citations
5,682 Views
22 Pages

Cascade Residual Multiscale Convolution and Mamba-Structured UNet for Advanced Brain Tumor Image Segmentation

  • Rui Zhou,
  • Ju Wang,
  • Guijiang Xia,
  • Jingyang Xing,
  • Hongming Shen and
  • Xiaoyan Shen

30 April 2024

In brain imaging segmentation, precise tumor delineation is crucial for diagnosis and treatment planning. Traditional approaches include convolutional neural networks (CNNs), which struggle with processing sequential data, and transformer models that...

  • Article
  • Open Access
1 Citations
2,555 Views
21 Pages

CCTFv2: Modeling Cyber Competitions

  • Basheer Qolomany,
  • Tristan J. Calay,
  • Liaquat Hossain,
  • Aos Mulahuwaish and
  • Jacques Bou Abdo

30 April 2024

Cyber competitions are usually team activities, where team performance not only depends on the members’ abilities but also on team collaboration. This seems intuitive, especially given that team formation is a well-studied discipline in competi...

  • Article
  • Open Access
2 Citations
2,846 Views
18 Pages

30 April 2024

Finding the most interesting areas of an image is the aim of saliency detection. Conventional methods based on low-level features rely on biological cues like texture and color. These methods, however, have trouble with processing complicated or low-...

of 2

XFacebookLinkedIn
Entropy - ISSN 1099-4300