Entropy 2017, 19(7), 341; https://doi.org/10.3390/e19070341
Photons, Bits and Entropy: From Planck to Shannon at the Roots of the Information Age
Dipartimento di Elettronica Informazione e Bioingegneria, Politecnico di Milano, Milano 20133, Italy
Received: 26 May 2017 / Revised: 3 July 2017 / Accepted: 4 July 2017 / Published: 8 July 2017
Abstract
The present age, which can be called the Information Age, has a core technology constituted by bits transported by photons. Both concepts, bit and photon, originated in the past century: the concept of photon was introduced by Planck in 1900 when he advanced the solution of the blackbody spectrum, and bit is a term first used by Shannon in 1948 when he introduced the theorems that founded information theory. The connection between Planck and Shannon is not immediately apparent; nor is it obvious that they derived their basic results from the concept of entropy. Examination of other important scientists can shed light on Planck’s and Shannon’s work in these respects. Darwin and Fowler, who in 1922 published a couple of papers where they reinterpreted Planck’s results, pointed out the centrality of the partition function to statistical mechanics and thermodynamics. The same roots have been more recently reconsidered by Jaynes, who extended the considerations advanced by Darwin and Fowler to information theory. This paper investigates how the concept of entropy was propagated in the past century in order to show how a simple intuition, born in the 1824 during the first industrial revolution in the mind of the young French engineer Carnot, is literally still enlightening the fourth industrial revolution and probably will continue to do so in the coming century. View Full-TextKeywords:
entropy; photon; bit; second law; information theory; blackbody radiation; Planck; Shannon
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).
Share & Cite This Article
MDPI and ACS Style
Martinelli, M. Photons, Bits and Entropy: From Planck to Shannon at the Roots of the Information Age. Entropy 2017, 19, 341.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.