Modeling deterministic echo state network with loop reservoir

Publication Type:
Journal Article
Citation:
Journal of Zhejiang University: Science C, 2012, 13 (9), pp. 689 - 701
Issue Date:
2012-09-01
Filename Description Size
10.1631%2Fjzus.C1200069.pdfPublished Version976.51 kB
Adobe PDF
Full metadata record
Echo state network (ESN), which efficiently models nonlinear dynamic systems, has been proposed as a special form of recurrent neural network. However, most of the proposed ESNs consist of complex reservoir structures, leading to excessive computational cost. Recently, minimum complexity ESNs were proposed and proved to exhibit high performance and low computational cost. In this paper, we propose a simple deterministic ESN with a loop reservoir, i.e., an ESN with an adjacentfeedback loop reservoir. The novel reservoir is constructed by introducing regular adjacent feedback based on the simplest loop reservoir. Only a single free parameter is tuned, which considerably simplifies the ESN construction. The combination of a simplified reservoir and fewer free parameters provides superior prediction performance. In the benchmark datasets and real-world tasks, our scheme obtains higher prediction accuracy with relatively low complexity, compared to the classic ESN and the minimum complexity ESN. Furthermore, we prove that all the linear ESNs with the simplest loop reservoir possess the same memory capacity, arbitrarily converging to the optimal value. © Zhejiang University and Springer-Verlag Berlin Heidelberg 2012.
Please use this identifier to cite or link to this item: