Next Article in Journal
Entropic Constitutive Relation and Modeling for Fourier and Hyperbolic Heat Conductions
Next Article in Special Issue
Assessment of Heart Rate Variability during an Endurance Mountain Trail Race by Multi-Scale Entropy Analysis
Previous Article in Journal
On the Deposition Equilibrium of Carbon Nanotubes or Graphite in the Reforming Processes of Lower Hydrocarbon Fuels
Previous Article in Special Issue
Parametric PET Image Reconstruction via Regional Spatial Bases and Pharmacokinetic Time Activity Model
Article Menu
Issue 12 (December) cover image

Export Article

Open AccessFeature PaperArticle
Entropy 2017, 19(12), 652;

Cosine Similarity Entropy: Self-Correlation-Based Complexity Analysis of Dynamical Systems

Department of Electrical and Electronic Engineering, Imperial College, SW7 2AZ London, UK
Author to whom correspondence should be addressed.
Received: 24 October 2017 / Revised: 20 November 2017 / Accepted: 27 November 2017 / Published: 30 November 2017
(This article belongs to the Special Issue Information Theory Applied to Physiological Signals)
Full-Text   |   PDF [2018 KB, uploaded 30 November 2017]   |  


The nonparametric Sample Entropy (SE) estimator has become a standard for the quantification of structural complexity of nonstationary time series, even in critical cases of unfavorable noise levels. The SE has proven very successful for signals that exhibit a certain degree of the underlying structure, but do not obey standard probability distributions, a typical case in real-world scenarios such as with physiological signals. However, the SE estimates structural complexity based on uncertainty rather than on (self) correlation, so that, for reliable estimation, the SE requires long data segments, is sensitive to spikes and erratic peaks in data, and owing to its amplitude dependence it exhibits lack of precision for signals with long-term correlations. To this end, we propose a class of new entropy estimators based on the similarity of embedding vectors, evaluated through the angular distance, the Shannon entropy and the coarse-grained scale. Analysis of the effects of embedding dimension, sample size and tolerance shows that the so introduced Cosine Similarity Entropy (CSE) and the enhanced Multiscale Cosine Similarity Entropy (MCSE) are amplitude-independent and therefore superior to the SE when applied to short time series. Unlike the SE, the CSE is shown to yield valid entropy values over a broad range of embedding dimensions. By evaluating the CSE and the MCSE over a variety of benchmark synthetic signals as well as for real-world data (heart rate variability of three different cardiovascular pathologies), the proposed algorithms are demonstrated to be able to quantify degrees of structural complexity in the context of self-correlation over small to large temporal scales, thus offering physically meaningful interpretations and rigor in the understanding the intrinsic properties of the structural complexity of a system, such as the number of its degrees of freedom. View Full-Text
Keywords: cosine similarity entropy; multiscale cosine similarity entropy; angular distance; cosine similarity; self-correlation-based complexity cosine similarity entropy; multiscale cosine similarity entropy; angular distance; cosine similarity; self-correlation-based complexity

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Chanwimalueang, T.; Mandic, D.P. Cosine Similarity Entropy: Self-Correlation-Based Complexity Analysis of Dynamical Systems. Entropy 2017, 19, 652.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top