Open AccessThis article is
- freely available
Information Entropy As a Basic Building Block of Complexity Theory
School of Mechanical Engineering and China-Asean Research Institute, Guangxi University,100 Daxue Road, Nanning 530005, China
PMB Intelligence LLC, Sunnyvale, CA 94087, USA
Management School, University of Chinese Academy of Sciences, Beijing 100190, China
* Author to whom correspondence should be addressed.
Received: 27 June 2013; in revised form: 12 August 2013 / Accepted: 12 August 2013 / Published: 29 August 2013
Abstract: What is information? What role does information entropy play in this information exploding age, especially in understanding emergent behaviors of complex systems? To answer these questions, we discuss the origin of information entropy, the difference between information entropy and thermodynamic entropy, the role of information entropy in complexity theories, including chaos theory and fractal theory, and speculate new fields in which information entropy may play important roles.
Keywords: information entropy; thermodynamic entropy; emergence; chaos; fractal; complexity theory; multiscale analysis
Citations to this Article
Cite This Article
MDPI and ACS Style
Gao, J.; Liu, F.; Zhang, J.; Hu, J.; Cao, Y. Information Entropy As a Basic Building Block of Complexity Theory. Entropy 2013, 15, 3396-3418.
Gao J, Liu F, Zhang J, Hu J, Cao Y. Information Entropy As a Basic Building Block of Complexity Theory. Entropy. 2013; 15(9):3396-3418.
Gao, Jianbo; Liu, Feiyan; Zhang, Jianfang; Hu, Jing; Cao, Yinhe. 2013. "Information Entropy As a Basic Building Block of Complexity Theory." Entropy 15, no. 9: 3396-3418.