Next Article in Journal
Determination of Optimal Water Quality Monitoring Points in Sewer Systems using Entropy Theory
Next Article in Special Issue
A Discrete Meta-Control Procedure for Approximating Solutions to Binary Programs
Previous Article in Journal
A New Perspective on Classical Ideal Gases
Previous Article in Special Issue
Synchronization of a Class of Fractional-Order Chaotic Neural Networks
Entropy 2013, 15(9), 3396-3418; doi:10.3390/e15093396
Article

Information Entropy As a Basic Building Block of Complexity Theory

1,2,* , 3
,
3
,
1,2
 and
2
1 School of Mechanical Engineering and China-Asean Research Institute, Guangxi University,100 Daxue Road, Nanning 530005, China 2 PMB Intelligence LLC, Sunnyvale, CA 94087, USA 3 Management School, University of Chinese Academy of Sciences, Beijing 100190, China
* Author to whom correspondence should be addressed.
Received: 27 June 2013 / Revised: 12 August 2013 / Accepted: 12 August 2013 / Published: 29 August 2013
(This article belongs to the Special Issue Dynamical Systems)
Download PDF [913 KB, uploaded 24 February 2015]

Abstract

What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.
Keywords: information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
EndNote
MDPI and ACS Style

Gao, J.; Liu, F.; Zhang, J.; Hu, J.; Cao, Y. Information Entropy As a Basic Building Block of Complexity Theory. Entropy 2013, 15, 3396-3418.

View more citation formats

Related Articles

Article Metrics

For more information on the journal, click here

Comments

Cited By

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert