Special Issue "Information-Theoretic Foundations of Data Processing"

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Signal and Data Analysis".

Deadline for manuscript submissions: 30 September 2021.

Special Issue Editor

Dr. Pasi Fränti
E-Mail Website
Guest Editor
School of Computing, University of Eastern Finland, Box 111, FIN-80101 Joensuu, Finland
Interests: data mining; clustering; LBS; compression; TSP; location-aware systems
Special Issues and Collections in MDPI journals

Special Issue Information

Information theory plays an important role in many methods in artificial intelligence, machine learning, pattern recognition and data mining. It is applied almost everywhere in data processing. Examples of its application are

  • Data clustering
  • Data compression (entropy coding)
  • Distance and similarity measures (Kullback–Leibler divergence)
  • Prediction (hidden Markov models)
  • Signal processing
  • Optimization

Traditionally, entropy is used as a measure of information, and Shannon’s entropy is the most widely used metric in this context. In data modeling, the goodness of a model can be measured by the entropy. It can be used to evaluate the number of bits needed in compression, the goodness of clustering, or the confidence of a prediction. Increasing the model decreases the entropy, leading to over-fitting.

Other formulations aim to measure the entropy of the entire system, including the model itself and the data described by this model. A classical approach is Kolmogorov’s complexity and the minimum description principle. However, there is a gap between the theoretical principles and practical applications.

This Special Issue calls for papers that offer novel contributions to the use of information-theoretic foundations of data processing. Topics include (but are not limited to) machine learning, data clustering, compression, distance and similarity measurement in various applications, prediction of future events, signal processing and optimization.

Dr. Pasi Fränti
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All papers will be peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1800 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Published Papers

This special issue is now open for submission.
Back to TopTop