Next Article in Journal
Analysis and Comparison of Spatial–Temporal Entropy Variability of Tehran City Microclimate Based on Climate Change Scenarios
Previous Article in Journal
Noise Reduction Method of Underwater Acoustic Signals Based on CEEMDAN, Effort-To-Compress Complexity, Refined Composite Multiscale Dispersion Entropy and Wavelet Threshold Denoising
Article Menu
Issue 1 (January) cover image

Export Article

Open AccessArticle
Entropy 2019, 21(1), 12;

Unique Information and Secret Key Agreement

Complexity Sciences Center and Physics Department, University of California at Davis, One Shields Avenue, Davis, CA 95616, USA
Author to whom correspondence should be addressed.
Received: 1 November 2018 / Revised: 12 December 2018 / Accepted: 16 December 2018 / Published: 24 December 2018
(This article belongs to the Section Information Theory, Probability and Statistics)
Full-Text   |   PDF [424 KB, uploaded 24 December 2018]   |  


The partial information decomposition (PID) is a promising framework for decomposing a joint random variable into the amount of influence each source variable X i has on a target variable Y, relative to the other sources. For two sources, influence breaks down into the information that both X 0 and X 1 redundantly share with Y, what X 0 uniquely shares with Y, what X 1 uniquely shares with Y, and finally what X 0 and X 1 synergistically share with Y. Unfortunately, considerable disagreement has arisen as to how these four components should be quantified. Drawing from cryptography, we consider the secret key agreement rate as an operational method of quantifying unique information. Secret key agreement rate comes in several forms, depending upon which parties are permitted to communicate. We demonstrate that three of these four forms are inconsistent with the PID. The remaining form implies certain interpretations as to the PID’s meaning—interpretations not present in PID’s definition but that, we argue, need to be explicit. Specifically, the use of a consistent PID quantified using a secret key agreement rate naturally induces a directional interpretation of the PID. We further reveal a surprising connection between third-order connected information, two-way secret key agreement rate, and synergy. We also consider difficulties which arise with a popular PID measure in light of the results here as well as from a maximum entropy viewpoint. We close by reviewing the challenges facing the PID. View Full-Text
Keywords: information theory; partial information decomposition; secret key agreement; cryptography information theory; partial information decomposition; secret key agreement; cryptography

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

James, R.G.; Emenheiser, J.; Crutchfield, J.P. Unique Information and Secret Key Agreement. Entropy 2019, 21, 12.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top