entropy-logo

Journal Browser

Journal Browser

Information Theory in Artificial Intelligence

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Information Theory, Probability and Statistics".

Deadline for manuscript submissions: 30 April 2026 | Viewed by 1000

Special Issue Editor


E-Mail Website
Guest Editor
1. Computer Science Division, School of Science and Technology, University of Camerino, 62032 Camerino, Italy
2. Vici&C. S.p.A., 47822 Santarcangelo di Romagna, Italy
Interests: anomaly detection; predictive maintenance; information theory; explainable AI; statistical learning
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

The convergence between Information Theory and Artificial Intelligence (AI) has emerged as a critical area of interdisciplinary research, fostering innovations in both theoretical frameworks and practical applications. Information–theoretic concepts, such as entropy, mutual information, Kullback–Leibler divergence, and the information bottleneck principle, offer rigorous tools for understanding and enhancing the learning dynamics, generalization behavior, and robustness of intelligent systems.

This Special Issue will explore the multifaceted roles of information–theoretic methods in modern AI, spanning areas such as statistical learning, deep neural networks, probabilistic modeling, and decision-making under uncertainty. In particular, we seek contributions that advance the theoretical foundations of AI through the lens of Information Theory, as well as empirical studies that demonstrate the effectiveness of such approaches in real-world scenarios. Applications of interest include, but are not limited to, anomaly detection, predictive maintenance, representation learning, and explainable AI—areas where managing uncertainty and extracting meaningful information from complex data are paramount.

By gathering diverse perspectives from both the Artificial Intelligence and Information Theory communities, this Special Issue will foster dialogue and promote novel insights to guide the development of next-generation intelligent systems grounded in principled information–theoretic approaches.

Dr. Marco Piangerelli
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 250 words) can be sent to the Editorial Office for assessment.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • information theory
  • artificial intelligence
  • entropy
  • machine learning
  • mutual information
  • anomaly detection
  • representation learning
  • predictive maintenance
  • statistical inference
  • explainable AI

Benefits of Publishing in a Special Issue

  • Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
  • Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
  • Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
  • External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
  • Reprint: MDPI Books provides the opportunity to republish successful Special Issues in book format, both online and in print.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (1 paper)

Order results
Result details
Select all
Export citation of selected articles as:

Research

27 pages, 2592 KB  
Article
SE-MSLC: Semantic Entropy-Driven Keyword Analysis and Multi-Stage Logical Combination Recall for Search Engine
by Haihua Lu, Liang Yu, Yantao He and Liwei Tian
Entropy 2025, 27(9), 961; https://doi.org/10.3390/e27090961 - 16 Sep 2025
Viewed by 568
Abstract
Information retrieval serves as a critical methodology for accurately and efficiently obtaining the required information from massive amounts of data. In this paper, we propose an information retrieval framework (SE-MSLC) that utilizes information theory to improve the retrieval effectiveness of inverted index retrieval, [...] Read more.
Information retrieval serves as a critical methodology for accurately and efficiently obtaining the required information from massive amounts of data. In this paper, we propose an information retrieval framework (SE-MSLC) that utilizes information theory to improve the retrieval effectiveness of inverted index retrieval, thus achieving higher-quality retrieval results in intelligent vertical domain search engines. First, we propose a semantic entropy-driven keyword importance analysis method (SE-KIA) in the query understanding module. This method combines search query logs, the corpus of the search engine, and the theory of semantic entropy, enabling the search engine to dynamically adjust the weights of query keywords, thereby improving its ability to recognize user intent. Then, we propose a hybrid recall strategy that combines a multi-stage strategy and a logical combination strategy (HRS-MSLC) in the recall module. It separately recalls the keywords obtained from the multi-granularity word segmentation of the query in the form of multi-queue recall and simultaneously considers the “AND” and “OR” logical relationships between the keywords. By systematically managing retrieval uncertainty and giving priority to the keywords with high information content, it achieves the best balance between the quantity of the retrieval results and the relevance of the retrieval results to the query. Finally, we experimentally evaluate our methods using the Hit Rate@K and case analysis. Our results demonstrate that the proposed method improves the Hit Rate@1 by 7.3% and the Hit Rate@3 by 6.6% while effectively solving the bad cases in our vertical domain search engine. Full article
(This article belongs to the Special Issue Information Theory in Artificial Intelligence)
Show Figures

Figure 1

Back to TopTop