Skip to Content
You are currently on the new version of our website. Access the old version .

4,291 Results Found

  • Article
  • Open Access
4 Citations
5,201 Views
7 Pages

Electron density is used to compute Shannon entropy. The deviation from the Hartree–Fock (HF) of this quantity has been observed to be related to correlation energy. Thus, Shannon entropy is here proposed as a valid quantity to assess the quality of...

(This article belongs to the Special Issue In Memory of Walter Kohn—Advances in Density Functional Theory)
  • Article
  • Open Access
17 Citations
4,377 Views
27 Pages

Entropy Pair Functional Theory: Direct Entropy Evaluation Spanning Phase Transitions

  • Donald M. Nicholson,
  • C. Y. Gao,
  • Marshall T. McDonnell,
  • Clifton C. Sluss and
  • David J. Keffer

17 February 2021

We prove that, within the class of pair potential Hamiltonians, the excess entropy is a universal, temperature-independent functional of the density and pair correlation function. This result extends Henderson’s theorem, which states that the free en...

  • Article
  • Open Access
14 Citations
13,087 Views
46 Pages

4 February 2010

In the biosemiotic literature there is a tension between the naturalistic reference to biological processes and the category of ‘meaning’ which is central in the concept of semiosis. A crucial term bridging the two dimensions is ‘information’. I argu...

  • Review
  • Open Access
19 Citations
4,738 Views
11 Pages

19 October 2018

The entropy of Boltzmann-Gibbs, as proved by Shannon and Khinchin, is based on four axioms, where the fourth one concerns additivity. The group theoretic entropies make use of formal group theory to replace this axiom with a more general composabilit...

(This article belongs to the Special Issue Nonadditive Entropies and Complex Systems)
  • Article
  • Open Access
17 Citations
5,344 Views
17 Pages

12 January 2018

In this paper we consider the metric entropies of the maps of an iterated function system deduced from a black hole which are known the Bekenstein–Hawking entropies and its subleading corrections. More precisely, we consider the recent model of a Boh...

(This article belongs to the Special Issue Entropic Aspects Arising from Geometric Descriptions of Physical Phenomena)
  • Article
  • Open Access
7 Citations
4,703 Views
25 Pages

16 July 2019

As a crucial concept of characterizing uncertainty, entropy has been widely used in fuzzy programming problems, while involving complicated calculations. To simplify the operations so as to broaden its applicable areas, this paper investigates the en...

(This article belongs to the Section Multidisciplinary Applications)
  • Article
  • Open Access
1 Citations
658 Views
22 Pages

5 December 2025

This paper introduces novel non-parametric entropy-based evidence functions and associated test statistics for assessing the dilation order of probability distributions constructed from cumulative residual entropy and cumulative entropy. The proposed...

(This article belongs to the Special Issue Entropy, Statistical Evidence, and Scientific Inference: Evidence Functions in Theory and Applications, 2nd Edition)
  • Article
  • Open Access
8 Citations
2,599 Views
16 Pages

21 August 2023

Response times (RT) distributions are routinely used by psychologists and neuroscientists in the assessment and modeling of human behavior and cognition. The statistical properties of RT distributions are valuable in uncovering unobservable psycholog...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
3 Citations
3,671 Views
19 Pages

Exploration of Entropy Pair Functional Theory

  • Clifton C. Sluss,
  • Jace Pittman,
  • Donald M. Nicholson and
  • David J. Keffer

26 April 2022

Evaluation of the entropy from molecular dynamics (MD) simulation remains an outstanding challenge. The standard approach requires thermodynamic integration across a series of simulations. Recent work Nicholson et al. demonstrated the ability to cons...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
10 Citations
8,910 Views
12 Pages

Entropy Measures for Stochastic Processes with Applications in Functional Anomaly Detection

  • Gabriel Martos,
  • Nicolás Hernández,
  • Alberto Muñoz and
  • Javier M. Moguerza

11 January 2018

We propose a definition of entropy for stochastic processes. We provide a reproducing kernel Hilbert space model to estimate entropy from a random sample of realizations of a stochastic process, namely functional data, and introduce two approaches to...

(This article belongs to the Special Issue Entropy in Signal Analysis)
  • Article
  • Open Access
10 Citations
3,181 Views
11 Pages

9 March 2021

In this paper, we study the entropy functions on extreme rays of the polymatroidal region which contain a matroid, i.e., matroidal entropy functions. We introduce variable strength orthogonal arrays indexed by a connected matroid M and positive integ...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
8,092 Views
27 Pages

1 November 2011

For fixed k ≥ 2 and fixed data alphabet of cardinality m, the hierarchical type class of a data string of length n = kj for some j ≥ 1 is formed by permuting the string in all possible ways under permutations arising from the isomorphisms of the uniq...

(This article belongs to the Special Issue Data Compression, Communication and Processing)
  • Article
  • Open Access
6 Citations
5,583 Views
10 Pages

24 May 2022

A new entropy function s+ is defined in terms of the existing entropy function s° and temperature as s+ = s° − R lnT to facilitate the analysis of isentropic processes of ideal gases with variable specific heats. The function s+ also makes it possibl...

(This article belongs to the Special Issue Exploring Fundamentals and Challenges of Heat, Entropy, and the Second Law of Thermodynamics: Honoring Professor Milivoje M. Kostic on the Occasion of His 70th Birthday)
  • Article
  • Open Access
96 Citations
6,858 Views
13 Pages

3 November 2018

How to measure the uncertainty of the basic probability assignment (BPA) function is an open issue in Dempster–Shafer (D–S) theory. The main work of this paper is to propose a new belief entropy, which is mainly used to measure the uncert...

(This article belongs to the Special Issue Information Theory and 5G Technologies)
  • Article
  • Open Access
36 Citations
4,917 Views
13 Pages

Double Entropy Joint Distribution Function and Its Application in Calculation of Design Wave Height

  • Guilin Liu,
  • Baiyu Chen,
  • Song Jiang,
  • Hanliang Fu and ,
  • Liping Wang and
  • Wei Jiang
  • + 1 author+ 0 author

14 January 2019

Wave height and wave period are important oceanic environmental factors that are used to describe the randomness of a wave. Within the field of ocean engineering, the calculation of design wave height is of great significance. In this paper, a period...

  • Article
  • Open Access
898 Views
26 Pages

Economic Entropy and the Cobb-Douglas Function: A Scientometric Analysis

  • Isabel Cristina Betancur-Hinestroza,
  • Nini Johana Marín-Rodríguez,
  • Francisco J. Caro-Lopera and
  • Éver Alberto Velásquez Sierra

22 April 2026

Economic entropy, as an emerging concept in econophysics, has gained increasing relevance in the analysis of complex systems characterized by uncertainty, nonlinearity, and out-of-equilibrium dynamics. However, its integration into conventional econo...

  • Article
  • Open Access
72 Citations
6,953 Views
15 Pages

11 November 2016

In order to solve the problem of feature extraction of underwater acoustic signals in complex ocean environment, a new method for feature extraction from ship-radiated noise is presented based on empirical mode decomposition theory and permutation en...

(This article belongs to the Section Complexity)
  • Article
  • Open Access
1 Citations
6,894 Views
26 Pages

27 July 2012

We derive a two-parameter family of generalized entropies, Spq, and means mpq. To this end, assume that we want to calculate an entropy and a mean for n non-negative real numbers {x1,…,xn}. For comparison, we consider {m1,…,mk} where mi = m for all i...

(This article belongs to the Special Issue Advances in Applied Thermodynamics)
  • Article
  • Open Access
8 Citations
3,753 Views
28 Pages

18 March 2019

Entropy has continuously arisen as one of the pivotal issues in optimization, mainly in portfolios, as an indicator of risk measurement. Aiming to simplify operations and extending applications of entropy in the field of LR fuzzy interval theory, thi...

  • Article
  • Open Access
3 Citations
2,435 Views
13 Pages

5 March 2021

The problem of randomized maximum entropy estimation for the probability density function of random model parameters with real data and measurement noises was formulated. This estimation procedure maximizes an information entropy functional on a set...

(This article belongs to the Special Issue Control, Optimization, and Mathematical Modeling of Complex Systems)
  • Article
  • Open Access
850 Views
17 Pages

10 February 2026

Background: Resting-state functional MRI (rs-fMRI) studies typically rely on linear Pearson correlation to characterize brain connectivity, potentially overlooking the distributional characteristics of functional networks. This study introduces a ker...

(This article belongs to the Section Neurotechnology and Neuroimaging)
  • Article
  • Open Access
5 Citations
3,483 Views
19 Pages

23 November 2021

Estimation of the probability density function from the statistical power moments presents a challenging nonlinear numerical problem posed by unbalanced nonlinearities, numerical instability and a lack of convergence, especially for larger numbers of...

  • Article
  • Open Access
1 Citations
2,015 Views
20 Pages

15 April 2024

Considering that the choice of loss function plays a significant role in the derivation of Bayesian estimators, we propose a novel asymmetric loss function named the weighted Q-symmetric entropy loss for computing the estimates of the parameter and r...

  • Article
  • Open Access
11 Citations
4,432 Views
18 Pages

Complexity Analysis of Benes Network and Its Derived Classes via Information Functional Based Entropies

  • Jun Yang,
  • Asfand Fahad,
  • Muzammil Mukhtar,
  • Muhammad Anees and ,
  • Amir Shahzad and
  • Zahid Iqbal
  • + 1 author+ 0 author

20 March 2023

The use of information–theoretical methodologies to assess graph-based systems has received a significant amount of attention. Evaluating a graph’s structural information content is a classic issue in fields such as cybernetics, pattern r...

(This article belongs to the Special Issue Combinatorics, Discrete Mathematics, Symmetry and Regularity in Graphs, Graph Indices, Graph Parameters and Applications of Graph Theory)
  • Article
  • Open Access
16 Citations
5,277 Views
17 Pages

18 February 2019

Catheter ablation of critical electrical propagation sites is a promising tool for reducing the recurrence of atrial fibrillation (AF). The spatial identification of the arrhythmogenic mechanisms sustaining AF requires the evaluation of electrograms...

(This article belongs to the Special Issue The 20th Anniversary of Entropy - Approximate and Sample Entropy)
  • Article
  • Open Access
148 Views
17 Pages

17 October 2026

As a classical signal processing tool based on second-order statistics (SOS), the ambiguity function (AF) can be formulated as a time-frequency correlation (TFC) function or a quadratic time-frequency distribution (QTFD). However, AF-based methods su...

  • Article
  • Open Access
8 Citations
4,080 Views
19 Pages

Construction and Application of Functional Brain Network Based on Entropy

  • Lingyun Zhang,
  • Taorong Qiu,
  • Zhiqiang Lin,
  • Shuli Zou and
  • Xiaoming Bai

30 October 2020

Functional brain network (FBN) is an intuitive expression of the dynamic neural activity interaction between different neurons, neuron clusters, or cerebral cortex regions. It can characterize the brain network topology and dynamic properties. The me...

(This article belongs to the Special Issue Multiscale Entropy Approaches and Their Applications II)
  • Article
  • Open Access
9 Citations
6,352 Views
19 Pages

12 October 2019

Brain complexity estimated using sample entropy and multiscale entropy (MSE) has recently gained much attention to compare brain function between diseased or neurologically impaired groups and healthy control groups. Using resting-state functional ma...

(This article belongs to the Special Issue Multiscale Entropy Approaches and Their Applications)
  • Article
  • Open Access
1,043 Views
21 Pages

Strongly F-Convex Functions with Structural Characterizations and Applications in Entropies

  • Hasan Barsam,
  • Slavica Ivelić Bradanović,
  • Matea Jelić and
  • Yamin Sayyari

16 December 2025

Strongly convex functions form a central subclass of convex functions and have gained considerable attention due to their structural advantages and broad applicability, particularly in optimization and information theory. In this paper, we investigat...

(This article belongs to the Special Issue Advances in Functional Analysis and Banach Space)
  • Article
  • Open Access
15 Citations
2,708 Views
16 Pages

Multi-Label Diagnosis of Arrhythmias Based on a Modified Two-Category Cross-Entropy Loss Function

  • Junjiang Zhu,
  • Cheng Ma,
  • Yihui Zhang,
  • Hao Huang and ,
  • Dongdong Kong and
  • Wangjin Ni
  • + 1 author+ 0 author

12 December 2023

The 12-lead resting electrocardiogram (ECG) is commonly used in hospitals to assess heart health. The ECG can reflect a variety of cardiac abnormalities, requiring multi-label classification. However, the diagnosis results in previous studies have be...

(This article belongs to the Topic Artificial Intelligence Models, Tools and Applications)
  • Article
  • Open Access
30 Citations
7,298 Views
12 Pages

Characterizing Complex Networks Using Entropy-Degree Diagrams: Unveiling Changes in Functional Brain Connectivity Induced by Ayahuasca

  • Aline Viol,
  • Fernanda Palhano-Fontes,
  • Heloisa Onias,
  • Draulio B. de Araujo and ,
  • Philipp Hövel and
  • Gandhi M. Viswanathan
  • + 1 author+ 0 author

30 January 2019

With the aim of further advancing the understanding of the human brain’s functional connectivity, we propose a network metric which we term the geodesic entropy. This metric quantifies the Shannon entropy of the distance distribution to a speci...

(This article belongs to the Special Issue Information Theory in Complex Systems)
  • Article
  • Open Access
1,534 Views
18 Pages

2 September 2025

Loss functions play a significant role in shaping model behavior in machine learning, yet their design implications remain underexplored in natural language processing tasks such as Named Entity Recognition (NER). This study investigates the performa...

(This article belongs to the Special Issue Natural Language Processing (NLP) with Applications and Natural Language Understanding (NLU))
  • Article
  • Open Access
4 Citations
1,693 Views
21 Pages

29 May 2025

To address the challenge of detecting low-frequency electric field signals from vessels in complex marine environments, a vessel shaft frequency electric field feature extraction method based on intrinsic mode function energy arrangement entropy valu...

(This article belongs to the Section Marine Science and Engineering)
  • Article
  • Open Access
1 Citations
3,838 Views
22 Pages

24 July 2025

This study examines how language functions impact linguistic features in academic and entertainment registers. Using multi-dimensional analysis (MDA) and computing entropy values, we analyze a large-scale Chinese corpus consisting of over 19 million...

(This article belongs to the Special Issue Complexity of Social Networks)
  • Article
  • Open Access
5 Citations
7,015 Views
19 Pages

8 March 2017

Artificial neural networks are widely applied for prediction, function simulation, and data classification. Among these applications, the wavelet neural network is widely used in image classification problems due to its advantages of high approximati...

(This article belongs to the Special Issue Wavelets, Fractals and Information Theory II)
  • Article
  • Open Access
3 Citations
3,597 Views
10 Pages

Multiscale Entropy of Resting-State Functional Magnetic Resonance Imaging Differentiates Progressive Supranuclear Palsy and Multiple System Atrophy

  • Katsuhiko Kadota,
  • Keiichi Onoda,
  • Satoshi Abe,
  • Chizuko Hamada and ,
  • Shingo Mitaki,
  • Hiroaki Oguro,
  • Atsushi Nagai,
  • Hajime Kitagaki and
  • Shuhei Yamaguchi
  • + 4 authors+ 0 author

16 December 2021

Distinguishing progressive supranuclear palsy (PSP) from multiple system atrophy (MSA) in the early clinical stages is challenging; few sensitive and specific biomarkers are available for their differential diagnosis. Resting-state functional magneti...

(This article belongs to the Topic Brain Functional and Structural Connectivity and Cognition)
  • Article
  • Open Access
10 Citations
5,484 Views
18 Pages

26 November 2019

Identifying brain regions contained in brain functional networks and functions of brain functional networks is of great significance in understanding the complexity of the human brain. The 160 regions of interest (ROIs) in the human brain determined...

(This article belongs to the Special Issue Assessing Complexity in Physiological Systems through Biomedical Signals Analysis)
  • Article
  • Open Access
8 Citations
6,512 Views
15 Pages

27 February 2017

The intent of shielding functions in delayed detached-eddy simulation methods (DDES) is to preserve the wall boundary layers as Reynolds-averaged Navier–Strokes (RANS) mode, avoiding possible modeled stress depletion (MSD) or even unphysical separati...

(This article belongs to the Special Issue Entropy in Computational Fluid Dynamics)
  • Article
  • Open Access
31 Citations
5,100 Views
22 Pages

2 January 2019

As a new type of jamming, the interrupted sampling repeater jamming (ISRJ) derived from the digital radio frequency memory (DRFM) technology, can generate coherent multiple false targets after pulse compression. At present, the traditional interferen...

(This article belongs to the Section Remote Sensors)
  • Article
  • Open Access
14 Citations
3,930 Views
16 Pages

22 July 2020

Due to the nature of the Dempster combination rule, it may produce results contrary to intuition. Therefore, an improved method for conflict evidence fusion is proposed. In this paper, the belief entropy in D–S theory is used to measure the unc...

(This article belongs to the Section Signal and Data Analysis)
  • Feature Paper
  • Article
  • Open Access
9 Citations
3,786 Views
16 Pages

26 June 2024

Over the past decade and a half, dynamic functional imaging has revealed low-dimensional brain connectivity measures, identified potential common human spatial connectivity states, tracked the transition patterns of these states, and demonstrated mea...

(This article belongs to the Section Entropy and Biology)
  • Article
  • Open Access
6 Citations
3,967 Views
14 Pages

Entropy-Based Graph Clustering of PPI Networks for Predicting Overlapping Functional Modules of Proteins

  • Hoyeon Jeong,
  • Yoonbee Kim,
  • Yi-Sue Jung,
  • Dae Ryong Kang and
  • Young-Rae Cho

28 September 2021

Functional modules can be predicted using genome-wide protein–protein interactions (PPIs) from a systematic perspective. Various graph clustering algorithms have been applied to PPI networks for this task. In particular, the detection of overlapping...

(This article belongs to the Special Issue Networks and Systems in Bioinformatics)
  • Article
  • Open Access
480 Views
24 Pages

1 August 2026

Familiar and unfamiliar face recognition is an important cognitive process with potential applications in brain-computer interface (BCI) systems and neurocognitive assessment. Classification of familiar and unfamiliar faces based on electroencephalog...

(This article belongs to the Section Signal and Data Analysis)
  • Article
  • Open Access
3 Citations
1,029 Views
22 Pages

21 November 2025

As land use performance undergoes abrupt shifts due to the transition from growth-centric to ecology-focused development, traditional evaluation methods often overlook the catastrophe characteristics of urban complex functions in the process of syste...

(This article belongs to the Special Issue The Role of Land Policy in Shaping Rural Development Outcomes)
  • Article
  • Open Access
1,758 Views
21 Pages

16 September 2025

This article aims to analyze the correlation between healthcare expenditure per capita in 2021 and the sum of the number of hospitalized patients, ICU admissions, confirmed COVID-19 cases, and deaths in a selected period of time. The analysis covers...

(This article belongs to the Special Issue Entropy-Based Time Series Analysis: Theory and Applications)
  • Article
  • Open Access
12 Citations
6,464 Views
27 Pages

2 February 2023

Electron temperature is reconsidered for weakly-ionized oxygen and nitrogen plasmas with its discharge pressure of a few hundred Pa, with its electron density of the order of 1017m−3 and in a state of non-equilibrium, based on thermodynamics an...

(This article belongs to the Section Thermodynamics)
  • Article
  • Open Access
3 Citations
2,615 Views
33 Pages

24 July 2023

The convergence rate for free-distribution functional data analyses is challenging. It requires some advanced pure mathematics functional analysis tools. This paper aims to bring several contributions to the existing functional data analysis literatu...

(This article belongs to the Special Issue Stochastic Models and Statistical Inference: Analysis and Applications)
  • Article
  • Open Access
6 Citations
4,523 Views
22 Pages

15 August 2021

In the rate-distortion function and the Maximum Entropy (ME) method, Minimum Mutual Information (MMI) distributions and ME distributions are expressed by Bayes-like formulas, including Negative Exponential Functions (NEFs) and partition functions. Wh...

(This article belongs to the Special Issue Measures of Information)

of 86