Next Article in Journal
Information Decomposition in Multivariate Systems: Definitions, Implementation and Application to Cardiovascular Networks
Next Article in Special Issue
Identifying Critical States through the Relevance Index
Previous Article in Journal
Quantum Key Distribution in the Presence of the Intercept-Resend with Faked States Attack
Previous Article in Special Issue
Consensus of Second Order Multi-Agent Systems with Exogenous Disturbance Generated by Unknown Exosystems
Article Menu
Issue 1 (January) cover image

Export Article

Open AccessArticle
Entropy 2017, 19(1), 3;

Echo State Condition at the Critical Point

Department of Electrical Engineering and Advanced Institute of Manufacturing with High-Tech Innovations (AIM-HI), National Chung Cheng University, Chia-Yi 62102, Taiwan
Academic Editor: Mikhail Prokopenko
Received: 29 October 2016 / Revised: 13 December 2016 / Accepted: 15 December 2016 / Published: 23 December 2016
(This article belongs to the Special Issue Complexity, Criticality and Computation (C³))
View Full-Text   |   Download PDF [638 KB, uploaded 23 December 2016]   |  


Recurrent networks with transfer functions that fulfil the Lipschitz continuity with K = 1 may be echo state networks if certain limitations on the recurrent connectivity are applied. It has been shown that it is sufficient if the largest singular value of the recurrent connectivity is smaller than 1. The main achievement of this paper is a proof under which conditions the network is an echo state network even if the largest singular value is one. It turns out that in this critical case the exact shape of the transfer function plays a decisive role in determining whether the network still fulfills the echo state condition. In addition, several examples with one-neuron networks are outlined to illustrate effects of critical connectivity. Moreover, within the manuscript a mathematical definition for a critical echo state network is suggested. View Full-Text
Keywords: reservoir computing; uniformly state contracting networks; power law reservoir computing; uniformly state contracting networks; power law

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Mayer, N.M. Echo State Condition at the Critical Point. Entropy 2017, 19, 3.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top