Entropy, Volume 26, Issue 11

The book amounts are modeled as values of a random variable, represented by a mixture of distributions of both the correct and error-contaminated amounts. The mixing coefficient represents the proportion of items with non-zero error amounts. This stu...

How do transformers model physics? Do transformers model systems with interpretable analytical solutions or do they create an “alien physics” that is difficult for humans to decipher? We have taken a step towards demystifying this larger...

We introduce derangetropy, which is a novel functional measure designed to characterize the dynamics of information within probability distributions. Unlike scalar measures such as Shannon entropy, derangetropy offers a functional representation that...

We analyze the generalization properties of batch reinforcement learning (batch RL) with value function approximation from an information-theoretic perspective. We derive generalization bounds for batch RL using (conditional) mutual information. In a...

Terahertz (THz) communication is a crucial technique in sixth generation (6G) mobile networks, which allow for ultra-wide bandwidths to enable ultra-high data rate wireless communication. However, the current subcarrier spacing and the size of fast F...

In a recent study, I demonstrated that large numbers of L2 (second language) speakers do not appear to influence the morphological or information-theoretic complexity of natural languages. This paper has three primary aims: First, I address recent cr...

In multi-label data, a sample is associated with multiple labels at the same time, and the computational complexity is manifested in the high-dimensional feature space as well as the interdependence and unbalanced distribution of labels, which leads...

Asa result of the time lag in transmission, the data obtained by the sensor is delayed and does not reflect the state at the current moment. The effects of input delay are often overlooked in active inference (AIF), which may lead to significant devi...

In physics, we construct idealized mathematical models in order to explain various phenomena which we observe or create in our laboratories. In this article, I recall how sophisticated mathematical models evolved from the concept of a number created...

The argument of this article is threefold. First, the article argues that from its rise in the sixteenth century to our own time, the advancement of modern physics as mathematical-experimental science has been defined by the invention of new mathemat...