作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2022, Vol. 48 ›› Issue (2): 92-98,105. doi: 10.19678/j.issn.1000-3428.0060532

• 人工智能与模式识别 • 上一篇    下一篇

一种深度回声状态网络的输入尺度自适应算法

刘鹏1, 叶润1, 闫斌1, 谢茜2, 刘睿2   

  1. 1. 电子科技大学 自动化工程学院, 成都 611731;
    2. 国网四川省电力公司电力科学研究院, 成都 610041
  • 收稿日期:2021-01-08 修回日期:2021-02-21 发布日期:2022-02-14
  • 作者简介:刘鹏(1995-),男,硕士,主研方向为机器学习及其应用;叶润,助理研究员;闫 斌,讲师;谢 茜,高级工程师;刘 睿,教授级高级工程师。
  • 基金资助:
    国家自然科学基金(61703060,61973055);四川省科技计划项目(2019YJ0165);中央高校基本科研业务费专项资金(ZYGX2020J011)。

An Adaptive Algorithm of Input Scale for Deep Echo State Networks

LIU Peng1, YE Run1, YAN Bin1, XIE Qian2, LIU Rui2   

  1. 1. School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
    2. Electric Power Research Institute of State Grid Sichuan Electric Power Company, Chengdu 610041, China
  • Received:2021-01-08 Revised:2021-02-21 Published:2022-02-14

摘要: 深度回声状态网络是回声状态网络与深度学习思想的结合,合理选取不同谱半径的内部状态矩阵和弱积分参数能有效增强深度回声状态网络的多尺度时域特性。利用数据可视化分析输出矩阵在不同网络层中的分布关系,发现高层网络中部分神经元处于饱和工作状态且该状态抑制了网络动态预测能力。提出一种深度回声状态网络的输入矩阵自适应算法,在对网络内部状态的均值和方差进行递推估计的基础上判断神经元饱和状态,通过自适应调整各层输入权重的值来增强神经元动态性。数值计算结果表明,基于输入尺度自适应算法的深度回声状态网络相对同等规模的单层回声状态网络对于动态系统的预测精度有成倍提升。

关键词: 回声状态网络, 动态系统, 广义逆算法, 多尺度时域特性, 机器学习

Abstract: Deep Echo State Networks(DESN) is a combination of Echo State Networks(ESN) and the idea of deep learning.A reasonable selection of internal state matrices and weak integration parameters with different spectral radius can effectively enhance the multi-scale time domain characteristics of the DESN.By analyzing the distribution of output matrix in different network layers through data visualization, it is found that part of the neurons in higher network layers are partially working in a saturated state, which weakens the dynamic prediction of the network.An adaptive algorithm of input matrix for DESN is proposed, based on the recursive estimation of the mean and variance of the internal network state, whether a neuron is saturated is judged.Then the output weight of each layer is adjusted adaptively to improve neuron dynamics.The numeric analysis results show that the DESN based on the input scale adaptive algorithm has doubled the prediction accuracy of the dynamic system compared with the single-layer ESN of the same scale.

Key words: Echo State Networks(ESN), dynamic system, generalized inverse algorithm, multi-scale time domain characteristic, machine learning

中图分类号: