Skip to Content
  • 2.1
    Impact Factor
  • 4.9
    CiteScore
  • 21 days
    Submission to First Decision
  • 4 days
    Acceptance to Publication

Entropy

Entropy is an international and interdisciplinary peer-reviewed open access journal of entropy and information studies, published monthly online by MDPI. The International Society for the Study of Information (IS4SI) and Spanish Society of Biomedical Engineering (SEIB) are affiliated with Entropy and their members receive a discount on the article processing charge.

Get Alerted

Add your email address to receive forthcoming issues of this journal.

All Articles (15,389)

  • Article
  • Open Access

Biological information is generally thought to be subject to selection for faithful maintenance. However, accurate preservation is often combined with regulated mechanisms that generate state change. Selectively advantageous instability (SAI) of biological information is modeled here as instability that is favored because useful alternatives become accessible. Modeling shows that active destabilization is favored above a threshold determined by environmental change, passive error, destabilization cost, and the relative adaptive targeting of active versus passive variation. When actively generated variation is sufficiently structured, selection simultaneously favors increased maintenance and increased active destabilization of the same information channel. This relationship is described as stabilization–destabilization complementarity. Shannon entropy quantifies uncertainty, whereas relative entropy quantifies mismatch between generated and fitness-relevant state distributions. Aging is not produced by reversible state-space exploration alone. Aging results when selected exploration also causes persistent or cumulative loss of maintained organization. Age and sex extensions show how delayed costs and shared genetic control can generate antagonistic pleiotropy and sexual conflict. A unified interpretation is provided in which SAI can be selected as a mechanism of adaptive state-space exploration even when long-term information displacement is costly.

Entropy

8 November 2026

Passive versus active destabilization. Conceptual distinction between passive, comparatively unstructured error and regulated active destabilization. Active destabilization can be retained when it samples recurrently useful alternative states more efficiently than passive error (η > θ).
  • Article
  • Open Access

Hyperspectral image (HSI) classification is hampered by the high cost of pixel-level annotation, which leaves supervised deep networks exposed to the high-dimensional small-sample problem. Semi-supervised learning (SSL) can exploit the abundant unlabeled pixels, but SSL frameworks designed for natural images do not directly account for the spectral continuity, the coupled spatial–spectral structure and the pronounced class imbalance of HSIs. Taking the weak-to-strong consistency framework UniMatch as a starting point, this paper proposes SEUM, a semi-supervised HSI classification network with three targeted modifications. First, a multi-branch parallel convolution block with squeeze-and-excitation recalibration replaces the single-path encoder so that spatial detail, spectral mixing and salient responses are captured at several scales. Second, a dual-head classifier separates supervised classification from pseudo-label generation, and feature-level dropout is combined with input-level strong augmentation to enlarge the consistency constraint. Third, an adaptive class-aware threshold lowers the confidence requirement for under-represented classes according to their instantaneous learning state, which counteracts the self-reinforcing bias of a fixed threshold. On the Pavia University, Houston 2013 and Kennedy Space Center benchmarks with 10% labeled samples, SEUM reaches overall accuracies of 96.67%, 92.81% and 95.99%, respectively, improving on UniMatch by 0.48–2.20 percentage points and on ten supervised and semi-supervised competitors, with the largest gains on spectrally confusable and texture-rich classes, and it shows consistent improvements in average accuracy, which reflect more balanced pseudo-label utilization across the class distribution. Ablation, pseudo-label quality, label-budget and sensitivity analyses confirm that the encoder, the dual head and the adaptive threshold contribute complementary and stable improvements.

Entropy

6 November 2026

Overall architecture of SEUM. Labeled patches are weakly augmented and supervised by 
  
    L
    
      c
      l
      s
    
  
 on both heads. Each unlabeled patch yields a weak view, two strongly augmented views and a feature-perturbed view. The pseudo-label head keeps the weak-view prediction only when its confidence exceeds the class-aware threshold, and the accepted label supervises the main-head predictions of the three perturbed views through 
  
    L
    
      s
      t
    
  
. At inference, only the encoder and the main head are used.
  • Article
  • Open Access

The Maxwellian distribution is rarely observed in space plasmas, as it represents the limiting case of zero correlations among particles. Nevertheless, it is often adopted as a reference example due to its simplicity, serving as a preliminary step before extending the method to kappa distributions, which more accurately capture the thermodynamics of correlated space plasma particles. In this paper, we employ the angular distribution associated with a drifting Maxwellian distribution to derive practical measures of angular spread and quantify their implications for solar-wind instrumentation. We then apply the resulting framework to OMNI observations near 1 AU to determine statistical requirements on instrument field of view and angular resolution. As an application, we illustrate how the angular spread can be used to determine the required field-of-view and angular resolution needed for a bulk solar wind monitor instrument near Earth.

Entropy

6 November 2026

Plots of the angular distributions Pc(cos ϑ) and Pϑ(ϑ), for various values of the ratio of thermal-to-bulk speeds θ/ub. Specifically, Pc(cos ϑ) is plotted in terms of (a) cos ϑ and (b) ϑ. The distribution Pϑ(ϑ) is plotted in terms of the angle ϑ in (c).
  • Article
  • Open Access

Generalized cross-entropy regression can be formulated as either a constrained primal optimization problem over probability distributions or a dual optimization problem over Lagrange multipliers. Although the two formulations are theoretically equivalent under the conditions considered, their performance depends on the optimization strategy. This study compares two primal and 10 dual routines targeting the generalized maximum entropy (GME) estimator to inform practical optimizer selection. The optimization formulations use the weighted generalized cross-entropy framework, which includes generalized cross-entropy and GME as particular cases. The Portland cement benchmark and 1000 simulated datasets varying sample size, predictor conditioning, and signal-to-noise ratio assess the routines under GME. We compare elapsed time and coefficient-recovery mean squared error (MSE), alongside interface-reported termination, common feasibility checks, and a separate dual-multiplier moment-residual diagnostic. The results reveal substantial differences in computational efficiency but smaller differences in coefficient-estimation accuracy among most routines. dual.lbfgsb3c has the lowest median time, while dual.BFGS combines competitive time and coefficient recovery and was selected as GCEstim’s default. Coefficient recovery and reported termination should be considered alongside numerical residuals. The comparison reflects a practical use case in which users do not tune each optimizer separately, yet relative performance at matched numerical accuracy remains to be established.

Entropy

6 November 2026

Overall Monte Carlo performance of the selected primal and dual optimization strategies. (a) Computation time in seconds. (b) Coefficient-estimation error measured by 
  
    MSE
    
      β
      ,
      W
      -
      GCE
      (
      0.5
      ,
      5
      ,
      3
      )
    
  
. Both horizontal axes use logarithmic scales. Purple denotes dual routines and green denotes primal routines.

Highly Accessed Articles

News & Conferences

Latest Issues

Open for Submission

Journal Sections

XFacebookLinkedIn
Entropy - ISSN 1099-4300