Machine Learning With Echo State Networks

Read::

TABLE without id
file.link as "Related Files",
title as "Title",
type as "type"
FROM "" AND -"ZZ. planning"
WHERE citekey = "xuMachineLearningEcho2020" 
SORT file.cday DESC

Abstract

This report aims at presenting a detailed technical review of Recurrent Neural Networks (RNNs) and in particular Echo State Networks (ESNs), which are networks belonging to the general class of Reservoir Computing. A general overview of RNNs is presented, followed by a detailed discussion of Reservoir Computing and Echo State Networks. We discuss the working principle, construction details, applications and limitations of ESNs. Current research work in ESNs directed towards overcoming some of the limitations faced by researchers using ESNs, is reviewed. One major limitation of ESNs is their dependence on the hyper-parameters. The stable operating region of ESNs in the hyper-parameter space is quite narrow, which makes training these networks a challenging task. The paper reviewed proposes a novel model of ESNs, which prevents the network from entering chaotic regime. The paper also demonstrates the improved performance in the experiments performed over standard benchmarking datasets for nonlinear systems. Finally, we conclude with a discussion of renewed interest in ESNs, in particular, as a computational principle.

Quick Reference

Top Comments

Let’s say grey is for overall comments

Tasks

Topics

Further Reading

β€”

Extracted Annotations and Comments

Figures