Information Theory, Probability and Statistics
A section of Entropy (ISSN 1099-4300).
Section Information
In 1948 C. E. Shannon published his paper “A Mathematical Theory of Communication” in the Bell Systems Technical Journal. He showed how information could be quantified with absolute precision, and demonstrated the essential unity of all information media. In brief, he introduced four groundbreaking concepts that were influential enough to help change the world. Thus, his most eminent result was the concept that every communication channel had a speed limit, measured in binary digits per second. Additionally, he also realized that the content of the message was irrelevant to its transmission, since once data is represented digitally it could be regenerated and transmitted without error. On the other hand, the efficient representation of data, i.e. the source coding, was another question that Shannon opened for discussion. Finally, his paper also defined the amount of information that can be sent down a noisy channel in terms of transmit power and bandwidth, thus introducing the concept of entropy.
From that moment, this theory has been widely applied to numerous scenarios, such as statistical inference, natural language processing, cryptography, neurobiology, molecular engineering, ecology, medical physics, biomedical engineering, thermal physics, quantum computing, linguistics, plagiarism detection, pattern recognition and anomaly detection, among others. Indeed, in recent decades, it has played a key role in the invention of the compact disc, the feasibility of mobile phones, the development of the Internet, the study of linguistics and of human perception, the understanding of black holes, as well as in numerous other fields.
This section, focuses on original and new research results regarding this broad and deep mathematical theory, as well as in diverse applications. Thus, manuscripts on source coding, channel coding, algorithmic complexity theory, algorithmic information theory, information–theoretic security, and measures of information, as well as on their application to traditional as well as novel scenarios are solicited. Submissions addressing critical up-to-date reviews will also be welcome. Download Section Flyer
Prof. Dr. Raúl Alcaraz Martínez
Section Editor-in-Chief
Keywords
Information Theory:
- communications and communications networks;
- sequences;
- coding theory and techniques;
- network coding and lattice theory;
- quantum information theory;
- signal processing;
- Shannon theory;
- complexity and cryptography;
- data compression;
- multi-user, multi-variate and hyper dimensional information theory;
- coded modulation;
- computational complexity;
- information dynamics and measures ;
- theoretical computer science and artificial intelligence;
- information theoretic learning;
- information fusion;
- fractional order generalized information;
- emerging applications of information theory in economics, medicine, biology, industry, thermodynamics, education, chemistry, physics, cognitive science, and social science;
- application of information theory in wireless/multimedia applications;
- application of information theory in image processing, computer graphics and visualization
Statistics:
- machine learning and its applications;
- deep learning and its applications;
- learning and inference;
- pattern recognition;
- statistical learning and data mining;
- information algebra/geometry;
- stochastic processes;
- computational statistics;
- statistical modeling;
- natural language processing;
- emerging applications of statistical theory in economics, medicine, biology, industry, thermodynamics, education, chemistry, physics, cognitive science,and social science
Probability:
- detection and estimation theory;
- probability theory;
- communication combinatorial problems;
- decision-making theory;
- emerging applications of probability theory in economics, medicine, biology, industry, thermodynamics, education, chemistry, physics, cognitive science, and social science
Editorial Board
Topical Advisory Panel
Special Issues
Following special issues within this section are currently open for submissions:
- Information-Theoretic Cryptography and Security (Deadline: 30 March 2024)
- Advances in Uncertain Information Fusion (Deadline: 31 March 2024)
- Foundations of Goal-Oriented Semantic Communication in Intelligent Networks (Deadline: 31 March 2024)
- Information Theory in Image Processing and Pattern Recognition (Deadline: 15 April 2024)
- Delay-Doppler Domain Communications for Future Wireless Networks (Deadline: 20 April 2024)
- Information Theory in Multi-Agent Systems: Methods and Applications (Deadline: 20 April 2024)
- Information Theory in Control Systems II (Deadline: 20 April 2024)
- Synergy and Redundancy Measures: Theory and Applications to Characterize Complex Systems and Shape Neural Network Representations (Deadline: 20 April 2024)
- Quantum and Classical Physical Cryptography (Deadline: 30 April 2024)
- Information Security and Privacy: From IoT to IoV II (Deadline: 30 April 2024)
- Integrated Information Theory and Consciousness II (Deadline: 15 May 2024)
- Information-Theoretic Methods in Deep Learning: Theory and Applications (Deadline: 15 May 2024)
- Information Theory for Interpretable Machine Learning (Deadline: 15 May 2024)
- Information Security and Data Privacy (Deadline: 15 May 2024)
- New Advances in Error-Correcting Codes (Deadline: 15 May 2024)
- Probabilistic Models for Dynamical Systems (Deadline: 20 May 2024)
- Bayesian Learning and Its Applications in Genomics (Deadline: 27 May 2024)
- Stochastic Models and Statistical Inference: Analysis and Applications (Deadline: 31 May 2024)
- Integrated Sensing and Communications (Deadline: 31 May 2024)
- Information Geometry for Data Analysis (Deadline: 31 May 2024)
- Privacy-Preserving Cryptography for Emerging Technologies: Applications and Challenges (Deadline: 15 June 2024)
- An Information-Theoretic Approach to Side-Channel Analysis (Deadline: 30 June 2024)
- Information-Theoretic Guided Methods for Information Network Mining and Its Applications (Deadline: 30 June 2024)
- Information Theory and Network Coding II (Deadline: 30 June 2024)
- Information Theory for MIMO Systems (Deadline: 15 July 2024)
- Wireless Communications: Signal Processing Perspectives (Deadline: 17 July 2024)
- Information Theoretic Criteria: New Theoretical Developments and Applications, 2nd Edition (Deadline: 18 July 2024)
- Learning from Games and Contests (Deadline: 20 July 2024)
- Towards Ultra-Low-Latency Video Communications (Deadline: 20 July 2024)
- Information and Self-Organization III (Deadline: 21 July 2024)
- Information Theory for Distributed Systems (Deadline: 25 July 2024)
- Cryptography and Data Security Based on Information Theory (Deadline: 30 July 2024)
- Signal Processing and Tensor Techniques for Communication and Positioning Systems (Deadline: 31 July 2024)
- Application of Information Theory to Computer Vision and Image Processing II (Deadline: 31 July 2024)
- Information-Theoretic Methods in Data Analytics (Deadline: 17 August 2024)
- Coding for Aeronautical Telemetry (Deadline: 20 August 2024)
- Advanced New Physical Layer Technologies for Next-Generation Wireless Communications (Deadline: 31 August 2024)
- Intelligent Information Processing and Coding for B5G Communications (Deadline: 31 August 2024)
- Information Theory and Coding for Image/Video Processing (Deadline: 31 August 2024)
- Shannon Entropy: Mathematical View (Deadline: 31 August 2024)
- Discrete Math in Coding Theory (Deadline: 19 September 2024)
- Entropy in Computational Linguistics (Deadline: 30 September 2024)
- Mathematics in Information Theory and Modern Applications (Deadline: 30 September 2024)
- Physics-Informed Neural Networks (Deadline: 30 October 2024)
- Statistical Methods for Modeling High-Dimensional and Complex Data: Second Edition (Deadline: 30 November 2024)
- Coding and Algorithms for DNA-Based Data Storage Systems (Deadline: 30 November 2024)
- Types of Entropies and Divergences with Their Applications II (Deadline: 28 February 2025)
Topical Collections
Following topical collections within this section are currently open for submissions: