Echo State Network (ESN) is an effective replacement for recurrent neural networks as a reservoir computing model. Similar to deep neural networks, adding hierarchical structure to an ESN is an effective way to improve the network efficiency. The paper examines the influence of the reservoir hierarchical structure on the network efficiency depending on the number of subreservoirs and the number of nodes in the reservoir, and also considers three main hyperparameters that influence the reservoir efficiency: leakage rate, spectral radius and input scale factor. To test the network efficiency, Mackey-Glass time series and power transformer data were selected as experimental data. Experimental results show that the reservoir hierarchical structure improves the prediction accuracy and reduces the computation time for the ESN model.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Research on Hierarchical Reservoir Neural Network

  • Mikhail S. Tarkov,
  • Ma Jing

摘要

Echo State Network (ESN) is an effective replacement for recurrent neural networks as a reservoir computing model. Similar to deep neural networks, adding hierarchical structure to an ESN is an effective way to improve the network efficiency. The paper examines the influence of the reservoir hierarchical structure on the network efficiency depending on the number of subreservoirs and the number of nodes in the reservoir, and also considers three main hyperparameters that influence the reservoir efficiency: leakage rate, spectral radius and input scale factor. To test the network efficiency, Mackey-Glass time series and power transformer data were selected as experimental data. Experimental results show that the reservoir hierarchical structure improves the prediction accuracy and reduces the computation time for the ESN model.