作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

›› 2003, Vol. 29 ›› Issue (05): 45-.

• 论文 • 上一篇    下一篇

一种基于状态聚类的SARSA(λ)强化学习算法

李春贵,吴沧浦,刘永信   

  1. 北京理工大学自动控制系,北京理工大学自动控制系,北京理工大学自动控制系 北京 100081
  • 发布日期:2003-03-15

SARSA( λ) Algorithm of Reinforcement Learning Basd on States Clustering

LI Chungui, WU Cangpu, LIU Yongxin   

  1. (Department of Automatic Control, Beijing Institute of Technology, Beijing 100081)
  • Published:2003-03-15

摘要: 为求解大状态空间的强化学习问题,提出了一种基于状态聚类的SARSA(λ)强化学习算法,其基本思想是利用先验知识或事先训练控制器,对状态空间进行聚类,分为不同的簇,然后在簇空间上进行SARSA(λ)学习。若能进行适当的状态聚类,算法将可得到一个相对好的近似值函数.

关键词: 强化学习, 函数近似, 状态聚类, SARSA学习

Abstract: For solving large-scale reinforcement learning problem, a new SARSA(λ) algorithm of reinforcement learning based on states clustering is proposed. The principle idea of the algorithm is that it can first use the prior knowledge or train the controller to cluster the state space, the state space is lelustered to many clusters, then do SARSA(λ) learning in the cluster space. If the states are clustered properly, the algorithm can get a suitable approximate value function.

中图分类号: