摘要： 强化学习是一个与环境交互的学习过程，在实验场景中，训练环境部署的可扩展性和算法验证的便捷性常受限于物理引擎和渲染模块的高耦合性。为对物理引擎和渲染模块进行解耦，构建一种面向物理引擎和渲染模块的云端交互式模型，其中包括操作字典、元素字典和对应的算法接口，并基于该模型实现模拟器。通过集成模拟器、可视化工具和知识管理等组件，搭建支持云端可视化交互的强化学习平台，并以MuJoCo物理引擎为例，验证Web模拟器接入自定义物理引擎的便捷性。实验和分析结果验证了该模型的有效性，其可方便接入平台，实现云端渲染并提高所属集群的利用率。

关键词: 强化学习平台, 物理引擎, 渲染模块, 云端可视化交互, 接口标准

Abstract: Reinforcement learning is a learning process that interacts with the environment.In the experiment environment,the scalability of the training environment deployment and the convenience of algorithm verification are often limited by the high coupling between the physics engine and the rendering module.To solve the problem,this paper proposes a Cloud Interactive Model(CIM) for physics engine and rendering module,which consists of an operation dictionary,element dictionary and relevant algorithm interfaces,and on this basis implements a simulator.Furthermore, this paper integrates the simulator,visualization tools,knowledge management and other components to build a Reinforcement Learning Platform(RLP) supporting cloud visual interaction.By taking the MuJoCo physics engine as an example,the Web simulator is verified for its convenience of access to a custom physics engine.Experimental and analytical results show that this model can be conveniently connected to the platform to realize cloud rendering and improve the utilization rate of its cluster.

Key words: Reinforcement Learning Platform(RLP), physics engine, rendering module, cloud visual interaction, interface standard

中图分类号: 

• TP391