Skip to Content

Entropy, Volume 26, Issue 12

2024 December - 132 articles

Cover Story: Kinetic theory refers to the physical and mathematical approaches to a systematic deduction of the macroscopic behavior of many-particle systems from first principles, that is, starting from the microscopic equations of motion. This work presents kinetic theory based upon the Landau equation, describing the one-particle function in a weak interaction limit for self-propelled particles with alignment interactions. Self-propelled particles—driven units that break the conservation of momentum on a particle scale—are the epitome of active matter. This paper illustrates such particles that interact with nematic symmetry. The relevant equations can be brought into a diagrammatic form (first three orders are shown), allowing us to quantitatively extract accurate predictions for agent-based simulations. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (132)

  • Article
  • Open Access
1,111 Views
15 Pages

23 December 2024

This study presents a detailed characterization of iterative steganography, a unique class of information-hiding techniques, and proposes a formal mathematical model for their description. A novel quantitative measure, the Incremental Information Fun...

  • Article
  • Open Access
3 Citations
1,851 Views
20 Pages

Transpiling Quantum Assembly Language Circuits to a Qudit Form

  • Denis A. Drozhzhin,
  • Anastasiia S. Nikolaeva,
  • Evgeniy O. Kiktenko and
  • Aleksey K. Fedorov

23 December 2024

In this paper, we introduce the workflow for converting qubit circuits represented by Open Quantum Assembly format (OpenQASM, also known as QASM) into the qudit form for execution on qudit hardware and provide a method for translating qudit experimen...

  • Article
  • Open Access
1 Citations
2,578 Views
18 Pages

Refining the Allostatic Self-Efficacy Theory of Fatigue and Depression Using Causal Inference

  • Alexander J. Hess,
  • Dina von Werder,
  • Olivia K. Harrison,
  • Jakob Heinzle and
  • Klaas Enno Stephan

23 December 2024

Allostatic self-efficacy (ASE) represents a computational theory of fatigue and depression. In brief, it postulates that (i) fatigue is a feeling state triggered by a metacognitive diagnosis of loss of control over bodily states (persistently elevate...

  • Feature Paper
  • Review
  • Open Access
14 Citations
11,323 Views
42 Pages

Applications of Entropy in Data Analysis and Machine Learning: A Review

  • Salomé A. Sepúlveda-Fontaine and
  • José M. Amigó

23 December 2024

Since its origin in the thermodynamics of the 19th century, the concept of entropy has also permeated other fields of physics and mathematics, such as Classical and Quantum Statistical Mechanics, Information Theory, Probability Theory, Ergodic Theory...

  • Article
  • Open Access
1 Citations
2,740 Views
17 Pages

Ornstein–Uhlenbeck Adaptation as a Mechanism for Learning in Brains and Machines

  • Jesús García Fernández,
  • Nasir Ahmad and
  • Marcel van Gerven

22 December 2024

Learning is a fundamental property of intelligent systems, observed across biological organisms and engineered systems. While modern intelligent systems typically rely on gradient descent for learning, the need for exact gradients and complex informa...

  • Article
  • Open Access
2 Citations
1,735 Views
14 Pages

Shannon Entropy Analysis of a Nuclear Fuel Pin Under Deep Burnup

  • Wojciech R. Kubiński,
  • Jan K. Ostrowski and
  • Krzysztof W. Fornalski

22 December 2024

This paper analyzes the behavior of the entropy of a nuclear fuel rod under deep burnup conditions, beyond standard operational ranges, reaching up to 60 years. The evolution of the neutron source distribution in a pressurized water reactor (PWR) fue...

  • Article
  • Open Access
1,139 Views
23 Pages

22 December 2024

Image segmentation is a crucial task in artificial intelligence fields such as computer vision and medical imaging. While convolutional neural networks (CNNs) have achieved notable success by learning representative features from large datasets, they...

  • Feature Paper
  • Article
  • Open Access
3 Citations
2,078 Views
45 Pages

22 December 2024

The status of the Second Law of Thermodynamics, even in the 21st century, is not as certain as when Arthur Eddington wrote about it a hundred years ago. It is not only about the truth of this law, but rather about its strict and exhaustive formulatio...

  • Article
  • Open Access
1,212 Views
12 Pages

Problem of Existence of Joint Distribution on Quantum Logic

  • Oľga Nánásiová,
  • Karla Čipková and
  • Michal Zákopčan

21 December 2024

This paper deals with the topics of modeling joint distributions on a generalized probability space. An algebraic structure known as quantum logic is taken as the basic model. There is a brief summary of some earlier published findings concerning a f...

  • Feature Paper
  • Article
  • Open Access
1 Citations
1,811 Views
11 Pages

Computing Entropy for Long-Chain Alkanes Using Linear Regression: Application to Hydroisomerization

  • Shrinjay Sharma,
  • Richard Baur,
  • Marcello Rigutto,
  • Erik Zuidema,
  • Umang Agarwal,
  • Sofia Calero,
  • David Dubbeldam and
  • Thijs J. H. Vlugt

21 December 2024

Entropies for alkane isomers longer than C10 are computed using our recently developed linear regression model for thermochemical properties which is based on second-order group contributions. The computed entropies show excellent agreement with expe...

  • Feature Paper
  • Review
  • Open Access
11 Citations
6,354 Views
21 Pages

20 December 2024

The efficacy of machine learning has increased exponentially over the past decade. The utilization of machine learning to predict and design materials has become a pivotal tool for accelerating materials development. High-entropy alloys are particula...

  • Article
  • Open Access
1 Citations
1,213 Views
16 Pages

EXIT Charts for Low-Density Algebra-Check Codes

  • Zuo Tang,
  • Jing Lei and
  • Ying Huang

20 December 2024

This paper focuses on the Low-Density Algebra-Check (LDAC) code, a novel low-rate channel code derived from the Low-Density Parity-Check (LDPC) code with expanded algebra-check constraints. A method for optimizing LDAC code design using Extrinsic Inf...

  • Article
  • Open Access
3 Citations
3,439 Views
17 Pages

20 December 2024

With the rapid increase in global data and rapid development of information technology, DNA sequences have been collected and manipulated on computers. This has yielded a new and attractive field of bioinformatics, DNA storage, where DNA has been con...

  • Article
  • Open Access
1 Citations
1,586 Views
21 Pages

20 December 2024

The transient plane source (TPS) method heat transfer model was established. A body-fitted coordinate system is proposed to transform the unstructured grid structure to improve the speed of solving the heat transfer direct problem of the winding prob...

  • Article
  • Open Access
3 Citations
2,110 Views
23 Pages

20 December 2024

This paper presents a method for lossless compression of images with fast decoding time and the option to select encoder parameters for individual image characteristics to increase compression efficiency. The data modeling stage was based on linear a...

  • Article
  • Open Access
15 Citations
4,765 Views
36 Pages

20 December 2024

In today’s digital age, ensuring the appropriateness of content for children is crucial for their cognitive and emotional development. The rise of automated text generation technologies, such as Large Language Models like LLaMA, Mistral, and Ze...

  • Article
  • Open Access
1 Citations
1,423 Views
17 Pages

20 December 2024

Diagnosing faults in wheelset bearings is critical for train safety. The main challenge is that only a limited amount of fault sample data can be obtained during high-speed train operations. This scarcity of samples impacts the training and accuracy...

  • Article
  • Open Access
1 Citations
2,085 Views
24 Pages

Network Coding-Enhanced Polar Codes for Relay-Assisted Visible Light Communication Systems

  • Congduan Li,
  • Mingyang Zhong,
  • Yiqian Zhang,
  • Dan Song,
  • Nanfeng Zhang and
  • Jingfeng Yang

19 December 2024

This paper proposes a novel polar coding scheme tailored for indoor visible light communication (VLC) systems. Simulation results demonstrate a significant reduction in bit error rate (BER) compared to uncoded transmission, with a coding gain of at l...

  • Article
  • Open Access
1,453 Views
14 Pages

Bayesian Assessment of Corrosion-Related Failures in Steel Pipelines

  • Fabrizio Ruggeri,
  • Enrico Cagno,
  • Franco Caron,
  • Mauro Mancini and
  • Antonio Pievatolo

19 December 2024

The probability of gas escapes from steel pipelines due to different types of corrosion is studied with real failure data from an urban gas distribution network. Both the design and maintenance of the network are considered, identifying and estimatin...

  • Article
  • Open Access
1 Citations
3,258 Views
20 Pages

A Novel Video Compression Approach Based on Two-Stage Learning

  • Dan Shao,
  • Ning Wang,
  • Pu Chen,
  • Yu Liu and
  • Lin Lin

19 December 2024

In recent years, the rapid growth of video data posed challenges for storage and transmission. Video compression techniques provided a viable solution to this problem. In this study, we proposed a bidirectional coding video compression model named De...

  • Feature Paper
  • Article
  • Open Access
1 Citations
1,328 Views
17 Pages

18 December 2024

Multi-stable behavior at the microscopic length-scale is fundamental for phase transformation phenomena observed in many materials. These phenomena can be driven not only by external mechanical forces but are also crucially influenced by disorder and...

  • Article
  • Open Access
2 Citations
1,494 Views
19 Pages

18 December 2024

In this paper, by using eleven entangled quantum states as a quantum channel, we propose a cyclic and asymmetric novel protocol for four participants in which both Alice and Bob can transmit two-qubit states, and Charlie can transmit three-qubit stat...

  • Article
  • Open Access
2 Citations
2,294 Views
15 Pages

18 December 2024

We discuss a family of W-class states describing three-qubit systems. For such systems, we analyze the relations between the entanglement measures and the nonlocality parameter for a two-mode mixed state related to the two-qubit subsystem. We find th...

  • Feature Paper
  • Article
  • Open Access
2 Citations
2,308 Views
16 Pages

18 December 2024

It is customary to classify approaches in statistical mechanics (SM) as belonging either to Boltzmanninan SM (BSM) or Gibbsian SM (GSM). It is, however, unclear how the Boltzmann equation (BE) fits into either of these approaches. To discuss the rela...

  • Feature Paper
  • Article
  • Open Access
2 Citations
988 Views
13 Pages

Enumerating Finitary Processes

  • Benjamin D. Johnson,
  • James P. Crutchfield,
  • Christopher J. Ellison and
  • Carl S. McTague

17 December 2024

We show how to efficiently enumerate a class of finite-memory stochastic processes using the causal representation of ϵ-machines. We characterize ϵ-machines in the language of automata theory and adapt a recent algorithm for generating ac...

  • Article
  • Open Access
2 Citations
1,531 Views
11 Pages

Stochastic Gradient Descent for Kernel-Based Maximum Correntropy Criterion

  • Tiankai Li,
  • Baobin Wang,
  • Chaoquan Peng and
  • Hong Yin

17 December 2024

Maximum correntropy criterion (MCC) has been an important method in machine learning and signal processing communities since it was successfully applied in various non-Gaussian noise scenarios. In comparison with the classical least squares method (L...

  • Article
  • Open Access
3 Citations
1,753 Views
21 Pages

17 December 2024

A fractal-order entropy dynamics model is developed to create a modified form of Maxwell’s time-dependent electromagnetic equations. The approach uses an information-theoretic method by combining Shannon’s entropy with fractional moment c...

  • Article
  • Open Access
3 Citations
1,642 Views
14 Pages

16 December 2024

We develop a novel key routing algorithm for quantum key distribution (QKD) networks that utilizes a distribution of keys between remote nodes, i.e., not directly connected by a QKD link, through multiple non-overlapping paths. This approach focuses...

  • Article
  • Open Access
3 Citations
9,165 Views
26 Pages

Sleep Stage Classification Through HRV, Complexity Measures, and Heart Rate Asymmetry Using Generalized Estimating Equations Models

  • Bartosz Biczuk,
  • Sebastian Żurek,
  • Szymon Jurga,
  • Elżbieta Turska,
  • Przemysław Guzik and
  • Jarosław Piskorski

16 December 2024

This study investigates whether heart rate asymmetry (HRA) parameters offer insights into sleep stages beyond those provided by conventional heart rate variability (HRV) and complexity measures. Utilizing 31 polysomnographic recordings, we focused ex...

  • Article
  • Open Access
1 Citations
2,104 Views
19 Pages

16 December 2024

Federated learning enables devices to train models collaboratively while protecting data privacy. However, the computing power, memory, and communication capabilities of IoT devices are limited, making it difficult to train large-scale models on thes...

  • Feature Paper
  • Article
  • Open Access
1 Citations
1,440 Views
9 Pages

Axiomatic Approach to Measures of Total Correlations

  • Gabriel L. Moraes,
  • Renato M. Angelo and
  • Ana C. S. Costa

15 December 2024

Correlations play a pivotal role in various fields of science, particularly in quantum mechanics, yet their proper quantification remains a subject of debate. In this work, we aimed to discuss the challenge of defining a reliable measure of total cor...

  • Feature Paper
  • Article
  • Open Access
1 Citations
1,600 Views
12 Pages

Stochastic Model for a Piezoelectric Energy Harvester Driven by Broadband Vibrations

  • Angelo Sanfelice,
  • Luigi Costanzo,
  • Alessandro Lo Schiavo,
  • Alessandro Sarracino and
  • Massimo Vitelli

14 December 2024

We present an experimental and numerical study of a piezoelectric energy harvester driven by broadband vibrations. This device can extract power from random fluctuations and can be described by a stochastic model, based on an underdamped Langevin equ...

  • Feature Paper
  • Article
  • Open Access
1,508 Views
16 Pages

14 December 2024

Heywood cases and other improper solutions occur frequently in latent variable models, e.g., factor analysis, item response theory, latent class analysis, multilevel models, or structural equation models, all of which are models with response variabl...

  • Article
  • Open Access
1 Citations
1,724 Views
20 Pages

14 December 2024

Attempts to mitigate the computational cost of fully resolved large-eddy simulation (LES) in the near-wall region include both the hybrid Reynolds-averaged Navier–Stokes/LES (HRL) and wall-modeled LES (WMLES) approaches. This paper presents an...

  • Article
  • Open Access
1,260 Views
11 Pages

14 December 2024

This work presents a perturbational decomposition method for simulating quantum evolution under the one-dimensional Ising model with both longitudinal and transverse fields. By treating the transverse field terms as perturbations in the expansion, ou...

  • Article
  • Open Access
4 Citations
1,219 Views
12 Pages

14 December 2024

This study investigates the effect of incorporating heavy dopant atoms on the topological transitions in the energy spectrum of graphene, as well as on its thermodynamic properties. A tight-binding model is employed that incorporates a lattice compos...

  • Article
  • Open Access
7 Citations
4,032 Views
20 Pages

13 December 2024

We study the emergence of agency from scratch by using Large Language Model (LLM)-based agents. In previous studies of LLM-based agents, each agent’s characteristics, including personality and memory, have traditionally been predefined. We focu...

  • Feature Paper
  • Article
  • Open Access
6 Citations
1,905 Views
9 Pages

13 December 2024

Statistical counting ad infinitum is the holographic observable to a statistical dynamics with finite states under independent and identically distributed N sampling. Entropy provides the infinitesimal probability for an observed empirical frequency...

  • Article
  • Open Access
2 Citations
1,531 Views
16 Pages

Control of Overfitting with Physics

  • Sergei V. Kozyrev,
  • Ilya A. Lopatin and
  • Alexander N. Pechen

13 December 2024

While there are many works on the applications of machine learning, not so many of them are trying to understand the theoretical justifications to explain their efficiency. In this work, overfitting control (or generalization property) in machine lea...

  • Article
  • Open Access
1 Citations
1,329 Views
11 Pages

Charactering Neural Spiking Activity Evoked by Acupuncture Through Coupling Generalized Linear Model

  • Qing Qin,
  • Kaiyue Zhang,
  • Yanqiu Che,
  • Chunxiao Han,
  • Yingmei Qin and
  • Shanshan Li

13 December 2024

Acupuncturing the ST36 acupoint can evoke a responding activity in the spinal dorsal root ganglia and generate spikes. In order to identify the responding mechanism of different acupuncture manipulations, in this paper the spike history of neurons is...

  • Article
  • Open Access
1,365 Views
18 Pages

12 December 2024

We study two harmonic oscillators with high quality factors, driven by equilibrium and off equilibrium thermal noise, the latter mimicked by establishing a temperature gradient. The two oscillators are coupled via a third reciprocal harmonic interact...

  • Article
  • Open Access
1 Citations
1,118 Views
17 Pages

12 December 2024

A coarse-grained model of a two-dimensional colloidal suspension was designed. The model was athermal and, in addition, a lattice approximation was introduced. It consisted of solvent (monomer) molecules, dimer molecules, and immobile impenetrable ob...

  • Article
  • Open Access
2 Citations
1,426 Views
17 Pages

12 December 2024

Chaotic systems can exhibit completely different behaviors given only slightly different initial conditions, yet it is possible to synchronize them through appropriate coupling. A wide variety of behaviors—complete chaos, complete synchronizati...

  • Article
  • Open Access
2 Citations
1,283 Views
20 Pages

Testing the Isotropic Cauchy Hypothesis

  • Jihad Fahs,
  • Ibrahim Abou-Faycal and
  • Ibrahim Issa

11 December 2024

The isotropic Cauchy distribution is a member of the central α-stable family that plays a role in the set of heavy-tailed distributions similar to that of the Gaussian density among finite second-moment laws. Given a sequence of n observations,...

  • Article
  • Open Access
1,997 Views
13 Pages

11 December 2024

Biological signals such as respiration (RSP) and heart rate (HR) are oscillatory and physiologically coupled, maintaining homeostasis through regulatory mechanisms. This report models the dynamic relationship between RSP and HR in 45 healthy voluntee...

  • Article
  • Open Access
2,268 Views
15 Pages

11 December 2024

Neural machine translation (NMT) systems have achieved outstanding performance and have been widely deployed in the real world. However, the undertranslation problem caused by the distribution of high-translation-entropy words in source sentences sti...

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300