Author Login Chief Editor Login Reviewer Login Editor Login Remote Office

Computer Engineering ›› 2026, Vol. 52 ›› Issue (9): 402-412. doi: 10.19678/j.issn.1000-3428.0070608

• Interdisciplinary Integration and Engineering Applications • Previous Articles     Next Articles

Path Planning Algorithm Based on PPO for Indoor Crowd Evacuation

DU Kangning1,2, YANG Xiaochen1,2, ZHANG Benkui3,4,*(), WANG Jinxiao3,4, SONG Peiran1,2, CAO Lin1,2   

  1. 1. Center for Target Cognition Information Processing Science and Technology, Beijing Information Science and Technology University, Beijing 100010, China
    2. School of Information and Communication Engineering, Beijing Information Science and Technology University, Beijing 100010, China
    3. Key Lab of Target Cognition and Application Technology, Beijing 100010, China
    4. Key Laboratory of Network Information System Technology (NIST), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100010, China
  • Received:2024-11-15 Revised:2025-01-16 Online:2026-09-15 Published:2025-04-24
  • Contact: ZHANG Benkui

基于PPO的室内人群疏散路径规划算法

杜康宁1,2, 杨晓晨1,2, 张本奎3,4,*(), 王金晓3,4, 宋沛然1,2, 曹林1,2   

  1. 1. 北京信息科技大学目标认知信息处理学科与技术中心, 北京 100010
    2. 北京信息科技大学信息与通信工程学院, 北京 100010
    3. 目标认知与应用技术国家级重点实验室, 北京 100010
    4. 中国科学院空天信息创新研究院网络信息体系技术重点实验室, 北京 100010
  • 通讯作者: 张本奎
  • 作者简介:

    杜康宁, 男, 副教授、博士, 主研方向为图像处理、人工智能

    杨晓晨, 硕士研究生

    张本奎(通信作者), 高级工程师、硕士

    王金晓, 助理研究员、博士

    宋沛然, 讲师、博士

    曹林, 教授、博士、博士生导师

  • 基金资助:
    国家自然科学基金(U20A20163); 国家自然科学基金(62201066)

Abstract:

With the frequent occurrence of terrorist attacks, crowd evacuation path planning in indoor public places has received increasing attention. This paper proposes a path planning method based on the Proximal Policy Optimization (PPO) algorithm to improve the efficiency and safety of pedestrian evacuation. The indoor terrorist attack scenario is described, and static obstacles, idle locations, dynamic obstacles, exits, and pedestrians in indoor public places are modeled using a cellular automata model. Subsequently, a feature construction method based on distance information is proposed to construct pedestrian features that represent the escape difficulty of evacuation paths, including shortest path features and safe path features, by combining the distance from pedestrians to exits in non-threatening environments and threat-facing scenarios. Finally, by describing the evacuation path planning problem as a reinforcement learning problem, a reward function based on evacuation efficiency, death penalty and successful escape reward is designed. Based on the feedback from the real-time environment, an evacuation strategy is provided to pedestrians, which in turn realizes the overall optimization of the escape path by the PPO algorithm. Compared with existing field methods, the proposed method can improve the efficiency and safety of crowd evacuation in different simulation scenarios, particularly in complex and high-density environments. The effectiveness of the shortest and safe path features is verified through ablation experiments.

Key words: terrorist attack, crowd evacuation, reinforcement learning, path planning, Proximal Policy Optimization (PPO)

摘要:

针对恐怖袭击事件频发的状况, 现有的疏散路径规划方法在面对复杂、动态环境时显得力不从心, 尤其在面临突发恐怖分子袭击时, 无法有效应对路径的阻塞和危险因素的变化。因此, 如何在复杂和高密度环境中实现高效、安全的人群疏散成为一个亟待解决的技术问题。针对室内公共场所人群疏散路径规划问题, 提出一种基于近端策略优化(PPO)算法的路径规划方法, 以提高行人疏散效率和安全性。首先, 对室内恐怖袭击场景进行描述, 采用元胞自动机模型对室内公共场所的静态障碍物、空闲位置、动态障碍物、出口和行人进行建模。然后, 在建模基础上, 提出基于距离信息的特征构建方法, 结合无威胁环境和面临威胁情况下行人到出口的距离, 构建包括最短路径特征和安全路径特征在内的行人特征, 以此刻画疏散路径的逃生难度。最后, 通过将疏散路径规划问题描述为强化学习问题, 设计基于疏散效率、死亡惩罚和成功逃离奖励的奖励函数。通过实时环境的反馈, 为行人提供疏散策略, 进而实现PPO算法对逃生路径的整体优化。与现有场域方法相比, 该方法能够提高不同仿真场景下的人群疏散效率和安全性, 尤其在复杂和高密度环境中。同时, 通过消融实验验证了最短路径特征和安全路径特征的有效性。

关键词: 恐怖袭击, 人群疏散, 强化学习, 路径规划, 近端策略优化