Next Article in Journal
Classification of Fractal Signals Using Two-Parameter Non-Extensive Wavelet Entropy
Previous Article in Journal
Minimum Entropy Active Fault Tolerant Control of the Non-Gaussian Stochastic Distribution System Subjected to Mean Constraint
Article Menu
Issue 5 (May) cover image

Export Article

Open AccessArticle
Entropy 2017, 19(5), 223;

Prediction and Evaluation of Zero Order Entropy Changes in Grammar-Based Codes

Department of Computer Science, FEECS, VSB-Technical University of Ostrava, 17. listopadu 15/12172, Ostrava 708 33, Czech Republic
Author to whom correspondence should be addressed.
Academic Editor: Raúl Alcaraz Martínez
Received: 30 January 2017 / Revised: 9 May 2017 / Accepted: 10 May 2017 / Published: 13 May 2017
(This article belongs to the Section Information Theory)
Full-Text   |   PDF [398 KB, uploaded 16 May 2017]   |  


The change of zero order entropy is studied over different strategies of grammar production rule selection. The two major rules are distinguished: transformations leaving the message size intact and substitution functions changing the message size. Relations for zero order entropy changes were derived for both cases and conditions under which the entropy decreases were described. In this article, several different greedy strategies reducing zero order entropy, as well as message sizes are summarized, and the new strategy MinEnt is proposed. The resulting evolution of the zero order entropy is compared with a strategy of selecting the most frequent digram used in the Re-Pair algorithm. View Full-Text
Keywords: data compression; grammars; entropy; transformations; context; Re-Pair data compression; grammars; entropy; transformations; context; Re-Pair

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Vasinek, M.; Platos, J. Prediction and Evaluation of Zero Order Entropy Changes in Grammar-Based Codes. Entropy 2017, 19, 223.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top