Advances in Biologically Inspired Reservoir Computing

Abstract

The interplay between randomness and optimization has always been a major theme in the design of neural networks [3]. In the last 15 years, the success of reservoir computing (RC) showed that, in many scenarios, the algebraic structure of the recurrent component is far more important than the precise fine-tuning of its weights. As long as the recurrent part of the network possesses a form of fading memory of the input, the dynamics of the neurons are enough to efficiently process many spatio-temporal signals, provided that their activations are sufficiently heterogeneous. Even if today it is feasible to fully optimize deep recurrent networks, their implementation still requires a vast degree of experience and practice, not to mention vast computational resources, limiting their applicability in simpler architectures (e.g., embedded systems) or in areas where time is of key importance (e.g., online systems). Not surprisingly, then, RC remains a powerful tool for quickly solving dynamical problems, and it has become an invaluable tool for modeling and analysis in neuroscience.

Publication DOI: https://doi.org/10.1007/s12559-017-9469-1
Divisions: College of Health & Life Sciences > Aston Pharmacy School
College of Health & Life Sciences
Additional Information: © Springer Nature B.V. 2017. The final publication is available at Springer via http://dx.doi.org/10.1007/s12559-017-9469-1
Full Text Link: http://eprints. ... ele.ac.uk/3330/
Related URLs: https://link.sp ... 2559-017-9469-1 (Publisher URL)
PURE Output Type: Article
Published Date: 2017-06-01
Published Online Date: 2017-04-28
Accepted Date: 2017-04-19
Authors: Scardapone, S
Butcher, John (ORCID Profile 0000-0002-2121-3000)
Bianchi, SM
Malik, ZK

Download

[img]

Version: Accepted Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record