Skip to Content

Entropy, Volume 25, Issue 6

2023 June - 129 articles

Cover Story: Neural networks (NNs) are very powerful function approximators, achieving super-human performance in a variety of tasks. However, under distribution shifts, they struggle to retain performance over previously learned skills. Sequential Bayesian inference provides a principled framework to update models given new data. We show a number of important caveats when working with sequential Bayesian inference over NN weights for continual learning. For example, applying exact sequential Bayesian inference is extremely difficult in practice. Also, by working with linear models, we show that, despite exact inference, we may still have poor performance with a misspecified model. We conclude that a more fruitful approach to continual learning is to model the data-generating process. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list .
  • You may sign up for email alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.

Articles (129)

  • Article
  • Open Access
8 Citations
3,267 Views
14 Pages

An Improved Toeplitz Approximation Method for Coherent DOA Estimation in Impulsive Noise Environments

  • Jiang’an Dai,
  • Tianshuang Qiu,
  • Shengyang Luan,
  • Quan Tian and
  • Jiacheng Zhang

20 June 2023

Direction of arrival (DOA) estimation is an important research topic in array signal processing and widely applied in practical engineering. However, when signal sources are highly correlated or coherent, conventional subspace-based DOA estimation al...

(This article belongs to the Special Issue Entropy and Information Theory in Machine Learning: Theoretical Insights and Applications)
  • Article
  • Open Access
3 Citations
2,858 Views
14 Pages

Identifying Important Nodes in Trip Networks and Investigating Their Determinants

  • Ze-Tao Li,
  • Wei-Peng Nie,
  • Shi-Min Cai,
  • Zhi-Dan Zhao and
  • Tao Zhou

20 June 2023

Describing travel patterns and identifying significant locations is a crucial area of research in transportation geography and social dynamics. Our study aims to contribute to this field by analyzing taxi trip data from Chengdu and New York City. Spe...

(This article belongs to the Special Issue Complexity, Entropy and the Physics of Information)
  • Article
  • Open Access
12 Citations
3,495 Views
19 Pages

Selection of an Insurance Company in Agriculture through Hybrid Multi-Criteria Decision-Making

  • Adis Puška,
  • Marija Lukić,
  • Darko Božanić,
  • Miroslav Nedeljković and
  • Ibrahim M. Hezam

20 June 2023

Crop insurance is used to reduce risk in agriculture. This research is focused on selecting an insurance company that provides the best policy conditions for crop insurance. A total of five insurance companies that provide crop insurance services in...

(This article belongs to the Special Issue Entropy Methods for Multicriteria Decision Making)
  • Feature Paper
  • Article
  • Open Access
1 Citations
2,355 Views
15 Pages

Finite-Size Relaxational Dynamics of a Spike Random Matrix Spherical Model

  • Pedro H. de Freitas Pimenta and
  • Daniel A. Stariolo

20 June 2023

We present a thorough numerical analysis of the relaxational dynamics of the Sherrington–Kirkpatrick spherical model with an additive non-disordered perturbation for large but finite sizes N. In the thermodynamic limit and at low temperatures,...

(This article belongs to the Special Issue Non-equilibrium Phase Transitions)
  • Article
  • Open Access
23 Citations
3,589 Views
10 Pages

20 June 2023

Security of quantum key distribution (QKD) protocols rely solely on quantum physics laws, namely, on the impossibility to distinguish between non-orthogonal quantum states with absolute certainty. Due to this, a potential eavesdropper cannot extract...

(This article belongs to the Special Issue Quantum Information: From Fundamental Aspects to Practical Applications)
  • Feature Paper
  • Article
  • Open Access
10 Citations
4,347 Views
16 Pages

19 June 2023

It seems that one cannot find many papers relating entropy to sport competitions. Thus, in this paper, I use (i) the Shannon intrinsic entropy (S) as an indicator of “teams sporting value” (or “competition performance”) and (i...

(This article belongs to the Special Issue Selected Featured Papers from Entropy Editorial Board Members)
  • Article
  • Open Access
8 Citations
4,263 Views
27 Pages

19 June 2023

In this paper, we present a general framework that provides a comprehensive and uniform treatment of integral majorization inequalities for convex functions and finite signed measures. Along with new results, we present unified and simple proofs of c...

(This article belongs to the Special Issue Shannon Entropy: Mathematical View)
  • Article
  • Open Access
1 Citations
2,605 Views
16 Pages

19 June 2023

As the Internet-of-Things is deployed widely, many time-series data are generated everyday. Thus, classifying time-series automatically has become important. Compression-based pattern recognition has attracted attention, because it can analyze variou...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Feature Paper
  • Article
  • Open Access
1,885 Views
11 Pages

17 June 2023

A thermodynamic process is a solution of the balance equations fulfilling the second law of thermodynamics. This implies restrictions on the constitutive relations. The most general way to exploit these restrictions is the method introduced by Liu. T...

(This article belongs to the Special Issue Thermodynamic Constitutive Theory and Its Application)
  • Article
  • Open Access
3 Citations
2,452 Views
15 Pages

16 June 2023

The long-term behavior of the weak solution of a fractional delayed reaction–diffusion equation with a generalized Caputo derivative is investigated. By using the classic Galerkin approximation method and comparison principal, the existence and...

(This article belongs to the Section Quantum Information)
  • Article
  • Open Access
6 Citations
2,805 Views
19 Pages

Multi-Focus Image Fusion for Full-Field Optical Angiography

  • Yuchan Jie,
  • Xiaosong Li,
  • Mingyi Wang and
  • Haishu Tan

16 June 2023

Full-field optical angiography (FFOA) has considerable potential for clinical applications in the prevention and diagnosis of various diseases. However, owing to the limited depth of focus attainable using optical lenses, only information about blood...

(This article belongs to the Special Issue Methods in Artificial Intelligence and Information Processing II)
  • Feature Paper
  • Article
  • Open Access
7 Citations
3,564 Views
20 Pages

Hierarchical Wilson–Cowan Models and Connection Matrices

  • W. A. Zúñiga-Galindo and
  • B. A. Zambrano-Luna

16 June 2023

This work aims to study the interplay between the Wilson–Cowan model and connection matrices. These matrices describe cortical neural wiring, while Wilson–Cowan equations provide a dynamical description of neural interaction. We formulate...

(This article belongs to the Special Issue New Trends in Theoretical and Mathematical Physics)
  • Article
  • Open Access
5 Citations
2,871 Views
13 Pages

A Novel Evidence Combination Method Based on Improved Pignistic Probability

  • Xin Shi,
  • Fei Liang,
  • Pengjie Qin,
  • Liang Yu and
  • Gaojie He

16 June 2023

Evidence theory is widely used to deal with the fusion of uncertain information, but the fusion of conflicting evidence remains an open question. To solve the problem of conflicting evidence fusion in single target recognition, we proposed a novel ev...

(This article belongs to the Special Issue Application of Information Theory to Physical Modeling and State Awareness in Complex Systems)
  • Feature Paper
  • Article
  • Open Access
1 Citations
2,349 Views
26 Pages

Increasing Extractable Work in Small Qubit Landscapes

  • Unnati Akhouri,
  • Sarah Shandera and
  • Gaukhar Yesmurzayeva

16 June 2023

An interesting class of physical systems, including those associated with life, demonstrates the ability to hold thermalization at bay and perpetuate states of high free-energy compared to a local environment. In this work we study quantum systems wi...

(This article belongs to the Section Non-equilibrium Phenomena)
  • Article
  • Open Access
19 Citations
5,411 Views
20 Pages

Combined Gaussian Mixture Model and Pathfinder Algorithm for Data Clustering

  • Huajuan Huang,
  • Zepeng Liao,
  • Xiuxi Wei and
  • Yongquan Zhou

16 June 2023

Data clustering is one of the most influential branches of machine learning and data analysis, and Gaussian Mixture Models (GMMs) are frequently adopted in data clustering due to their ease of implementation. However, there are certain limitations to...

(This article belongs to the Section Signal and Data Analysis)
  • Article
  • Open Access
1 Citations
2,802 Views
12 Pages

15 June 2023

From the perspective of network attackers, finding attack sequences that can cause significant damage to network controllability is an important task, which also helps defenders improve robustness during network constructions. Therefore, developing e...

(This article belongs to the Topic Complex Systems and Network Science)
  • Review
  • Open Access
12 Citations
2,328 Views
17 Pages

Irreversible Geometrothermodynamics of Open Systems in Modified Gravity

  • Miguel A. S. Pinto,
  • Tiberiu Harko and
  • Francisco S. N. Lobo

15 June 2023

In this work, we explore the formalism of the irreversible thermodynamics of open systems and the possibility of gravitationally generated particle production in modified gravity. More specifically, we consider the scalar–tensor representation...

(This article belongs to the Special Issue Geometrothermodynamics and Its Applications)
  • Article
  • Open Access
14 Citations
4,821 Views
13 Pages

15 June 2023

This paper demonstrates the use of software-defined networking (SDN) orchestration to integrate regionally separated networks in which different network parts use incompatible key management systems (KMSs) managed by different SDN controllers to ensu...

(This article belongs to the Special Issue Quantum Communications Networks & Cryptography: From Devices to Industrial Practice)
  • Feature Paper
  • Article
  • Open Access
1 Citations
2,582 Views
21 Pages

Statistical Analysis of Plasma Dynamics in Gyrokinetic Simulations of Stellarator Turbulence

  • Aristeides D. Papadopoulos,
  • Johan Anderson,
  • Eun-jin Kim,
  • Michail Mavridis and
  • Heinz Isliker

15 June 2023

A geometrical method for assessing stochastic processes in plasma turbulence is investigated in this study. The thermodynamic length methodology allows using a Riemannian metric on the phase space; thus, distances between thermodynamic states can be...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
10 Citations
3,450 Views
23 Pages

15 June 2023

Due to its wide application across many disciplines, how to make an efficient ranking for nodes in graph data has become an urgent topic. It is well-known that most classical methods only consider the local structure information of nodes, but ignore...

  • Article
  • Open Access
4 Citations
2,186 Views
13 Pages

Exploring a New Application of Construct Specification Equations (CSEs) and Entropy: A Pilot Study with Balance Measurements

  • Jeanette Melin,
  • Helena Fridberg,
  • Eva Ekvall Hansson,
  • Daniel Smedberg and
  • Leslie Pendrill

15 June 2023

Both construct specification equations (CSEs) and entropy can be used to provide a specific, causal, and rigorously mathematical conceptualization of item attributes in order to provide fit-for-purpose measurements of person abilities. This has been...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
2,703 Views
9 Pages

15 June 2023

In classical physics, there is a well-known theorem in which it is established that the energy per degree of freedom is the same. However, in quantum mechanics, due to the non-commutativity of some pairs of observables and the possibility of having n...

(This article belongs to the Collection Foundations of Statistical Mechanics)
  • Article
  • Open Access
14 Citations
5,002 Views
17 Pages

Attention-Based Spatial–Temporal Convolution Gated Recurrent Unit for Traffic Flow Forecasting

  • Qingyong Zhang,
  • Wanfeng Chang,
  • Conghui Yin,
  • Peng Xiao,
  • Kelei Li and
  • Meifang Tan

14 June 2023

Accurate traffic flow forecasting is very important for urban planning and traffic management. However, this is a huge challenge due to the complex spatial–temporal relationships. Although the existing methods have researched spatial–temp...

(This article belongs to the Special Issue Application of Information Theory to Physical Modeling and State Awareness in Complex Systems)
  • Article
  • Open Access
4 Citations
2,379 Views
12 Pages

14 June 2023

Continuous-variable quantum key distribution (CVQKD) plays an important role in quantum communications, because of its compatible setup for optical implementation with low cost. For this paper, we considered a neural network approach to predicting th...

(This article belongs to the Special Issue Quantum Communication and Quantum Key Distribution)
  • Article
  • Open Access
4 Citations
3,626 Views
18 Pages

13 June 2023

Currently, sentiment analysis is a research hotspot in many fields such as computer science and statistical science. Topic discovery of the literature in the field of text sentiment analysis aims to provide scholars with a quick and effective underst...

(This article belongs to the Special Issue Information-Theoretic Methods in Data Analytics)
  • Article
  • Open Access
4 Citations
2,279 Views
22 Pages

Genetic Algebras Associated with ξ(a)-Quadratic Stochastic Operators

  • Farrukh Mukhamedov,
  • Izzat Qaralleh,
  • Taimun Qaisar and
  • Mahmoud Alhaj Hasan

13 June 2023

The present paper deals with a class of ξ(a)-quadratic stochastic operators, referred to as QSOs, on a two-dimensional simplex. It investigates the algebraic properties of the genetic algebras associated with ξ(a)-QSOs. Namely, the associativit...

(This article belongs to the Special Issue New Trends in Theoretical and Mathematical Physics)
  • Article
  • Open Access
3 Citations
3,285 Views
13 Pages

13 June 2023

Deep learning models have achieved an impressive performance in a variety of tasks, but they often suffer from overfitting and are vulnerable to adversarial attacks. Previous research has shown that dropout regularization is an effective technique th...

(This article belongs to the Special Issue Signal and Information Processing in Networks)
  • Article
  • Open Access
15 Citations
5,509 Views
18 Pages

13 June 2023

Low-light image enhancement aims to improve the perceptual quality of images captured under low-light conditions. This paper proposes a novel generative adversarial network to enhance low-light image quality. Firstly, it designs a generator consistin...

(This article belongs to the Special Issue Deep Learning Models and Applications to Computer Vision)
  • Article
  • Open Access
21 Citations
4,697 Views
15 Pages

13 June 2023

Since its conception, the cryptocurrency market has been frequently described as an immature market, characterized by significant swings in volatility and occasionally described as lacking rhyme or reason. There has been great speculation as to what...

(This article belongs to the Special Issue Signatures of Maturity in Cryptocurrency Market)
  • Article
  • Open Access
2 Citations
2,164 Views
13 Pages

13 June 2023

To improve the decoding performance of asynchronous sparse code multiple access (SCMA) systems over additive white Gaussian noise (AWGN) channels, this paper proposes a novel windowed joint detection and decoding algorithm for a rate-compatible (RC),...

(This article belongs to the Special Issue Coding and Entropy)
  • Article
  • Open Access
12 Citations
4,416 Views
11 Pages

Threshold Cascade Dynamics in Coevolving Networks

  • Byungjoon Min and
  • Maxi San Miguel

13 June 2023

We study the coevolutionary dynamics of network topology and social complex contagion using a threshold cascade model. Our coevolving threshold model incorporates two mechanisms: the threshold mechanism for the spreading of a minority state such as a...

(This article belongs to the Special Issue Statistical Physics of Opinion Formation and Social Phenomena)
  • Article
  • Open Access
11 Citations
3,200 Views
14 Pages

Coupled Information–Epidemic Spreading Dynamics with Selective Mass Media

  • Jiajun Xian,
  • Zhihong Zhang,
  • Zongyi Li and
  • Dan Yang

12 June 2023

As a pandemic emerges, information on epidemic prevention disseminates among the populace, and the propagation of that information interacts with the proliferation of the disease. Mass media serve a pivotal function in facilitating the dissemination...

(This article belongs to the Special Issue Complexity, Entropy and the Physics of Information)
  • Article
  • Open Access
10 Citations
5,172 Views
22 Pages

User Real-Time Influence Ranking Algorithm of Social Networks Considering Interactivity and Topicality

  • Zhaohui Li,
  • Wenjia Piao,
  • Zhengyi Sun,
  • Lin Wang,
  • Xiaoqian Wang and
  • Wenli Li

12 June 2023

At present, the existing influence evaluation algorithms often ignore network structure attributes, user interests and the time-varying propagation characteristics of influence. To address these issues, this work comprehensively discusses users&rsquo...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
2 Citations
2,253 Views
23 Pages

12 June 2023

Measuring the correlation between belief functions is an important issue in Dempster–Shafer theory. From the perspective of uncertainty, analyzing the correlation may provide a more comprehensive reference for uncertain information processing....

(This article belongs to the Special Issue Advances in Uncertain Information Fusion)
  • Article
  • Open Access
6 Citations
2,983 Views
29 Pages

Shaped-Charge Learning Architecture for the Human–Machine Teams

  • Boris Galitsky,
  • Dmitry Ilvovsky and
  • Saveli Goldberg

12 June 2023

In spite of great progress in recent years, deep learning (DNN) and transformers have strong limitations for supporting human–machine teams due to a lack of explainability, information on what exactly was generalized, and machinery to be integr...

(This article belongs to the Special Issue An Entropy Approach to the Structure and Performance of Interdependent Autonomous Human Machine Teams and Systems (A-HMT-S))
  • Feature Paper
  • Article
  • Open Access
17 Citations
4,254 Views
14 Pages

Distances in Higher-Order Networks and the Metric Structure of Hypergraphs

  • Ekaterina Vasilyeva,
  • Miguel Romance,
  • Ivan Samoylenko,
  • Kirill Kovalenko,
  • Daniil Musatov,
  • Andrey Mihailovich Raigorodskii and
  • Stefano Boccaletti

12 June 2023

We explore the metric structure of networks with higher-order interactions and introduce a novel definition of distance for hypergraphs that extends the classic methods reported in the literature. The new metric incorporates two critical factors: (1)...

(This article belongs to the Special Issue Models, Topology and Inference of Multilayer and Higher-Order Networks)
  • Review
  • Open Access
25 Citations
8,043 Views
27 Pages

A Systematic Review of INGARCH Models for Integer-Valued Time Series

  • Mengya Liu,
  • Fukang Zhu,
  • Jianfeng Li and
  • Chuning Sun

11 June 2023

Count time series are widely available in fields such as epidemiology, finance, meteorology, and sports, and thus there is a growing demand for both methodological and application-oriented research on such data. This paper reviews recent developments...

(This article belongs to the Special Issue Discrete-Valued Time Series)
  • Article
  • Open Access
4 Citations
2,245 Views
47 Pages

11 June 2023

The utilization of databases such as IoT has progressed, and understanding how to protect the privacy of data is an important issue. As pioneering work, in 1983, Yamamoto assumed the source (database), which consists of public information and private...

(This article belongs to the Special Issue Advances in Information and Coding Theory)
  • Feature Paper
  • Article
  • Open Access
7 Citations
3,306 Views
23 Pages

10 June 2023

In this paper, we study distributed inference and learning over networks which can be modeled by a directed graph. A subset of the nodes observes different features, which are all relevant/required for the inference task that needs to be performed at...

(This article belongs to the Special Issue Theory and Application of the Information Bottleneck Method)
  • Article
  • Open Access
11 Citations
1,982 Views
45 Pages

10 June 2023

Using the Luchko’s general fractional calculus (GFC) and its extension in the form of the multi-kernel general fractional calculus of arbitrary order (GFC of AO), a nonlocal generalization of probability is suggested. The nonlocal and general f...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
1 Citations
2,254 Views
9 Pages

9 June 2023

In order to study as a whole a wide part of entropy measures, we introduce a two-parameter non-extensive entropic form with respect to the h-derivative, which generalizes the conventional Newton–Leibniz calculus. This new entropy, Sh,h′,...

(This article belongs to the Special Issue Non-additive Entropy Formulas: Motivation and Derivations)
  • Article
  • Open Access
6 Citations
3,945 Views
32 Pages

Predicting Network Hardware Faults through Layered Treatment of Alarms Logs

  • Antonio Massaro,
  • Dimitre Kostadinov,
  • Alonso Silva,
  • Alexander Obeid Guzman and
  • Armen Aghasaryan

9 June 2023

Maintaining and managing ever more complex telecommunication networks is an increasingly difficult task, which often challenges the capabilities of human experts. There is a consensus both in academia and in the industry on the need to enhance human...

(This article belongs to the Special Issue Fault Diagnosis Methods Based on Information Theory or Machine Learning: From Theory to Application)
  • Article
  • Open Access
4 Citations
3,927 Views
16 Pages

9 June 2023

The ability to predict the size of information cascades in online social networks is crucial for various applications, including decision-making and viral marketing. However, traditional methods either rely on complicated time-varying features that a...

(This article belongs to the Special Issue Complexity, Entropy and the Physics of Information)
  • Article
  • Open Access
2,030 Views
8 Pages

9 June 2023

Assuming that the energy of a gas depends non-locally on the logarithm of its mass density, the body force in the resulting equation of motion consists of the sum of density gradient terms. Truncating this series after the second term, Bohm’s q...

(This article belongs to the Special Issue Selected Featured Papers from Entropy Editorial Board Members)
  • Article
  • Open Access
18 Citations
4,455 Views
20 Pages

9 June 2023

When traditional super-resolution reconstruction methods are applied to infrared thermal images, they often ignore the problem of poor image quality caused by the imaging mechanism, which makes it difficult to obtain high-quality reconstruction resul...

(This article belongs to the Special Issue Application of Information Theory to Computer Vision and Image Processing)
  • Article
  • Open Access
7 Citations
1,995 Views
17 Pages

9 June 2023

Adaptive interactions are an important property of many real-word network systems. A feature of such networks is the change in their connectivity depending on the current states of the interacting elements. In this work, we study the question of how...

(This article belongs to the Special Issue Synchronization in Complex Networks of Nonlinear Dynamical Systems)
  • Article
  • Open Access
1 Citations
3,008 Views
16 Pages

8 June 2023

We introduce a new family of quantum distances based on symmetric Csiszár divergences, a class of distinguishability measures that encompass the main dissimilarity measures between probability distributions. We prove that these quantum distanc...

(This article belongs to the Special Issue Mathematics in Information Theory and Modern Applications)
  • Article
  • Open Access
1 Citations
2,766 Views
22 Pages

Entropy Stable DGSEM Schemes of Gauss Points Based on Subcell Limiting

  • Yang Liu,
  • Huajun Zhu,
  • Zhen-Guo Yan,
  • Feiran Jia and
  • Xinlong Feng

8 June 2023

The discontinuous Galerkin spectral element method (DGSEM) is a compact and high-order method applicable to complex meshes. However, the aliasing errors in simulating under-resolved vortex flows and non-physical oscillations in simulating shock waves...

(This article belongs to the Collection Advances in Applied Statistical Mechanics)

of 3

XFacebookLinkedIn
Entropy - ISSN 1099-4300