论文标题

基于P-MADDPG的新兴事件的决策

Decision-making of Emergent Incident based on P-MADDPG

论文作者

Guo, Yibo, Hou, Lishuo, Li, Mingxin, Yuan, Yue, Liu, Shun, Xue, Jingyi, Han, Yafang, Xu, Mingliang

论文摘要

近年来,人身伤亡和对新事件造成的资源的损害已成为全球一个严重的问题。在本文中,我们对紧急决策问题进行建模,并使用多代理系统(MAS)解决决策速度无法跟上扩散速度的问题。 MAS可以在这些任务的自动执行中发挥重要作用,以减少任务完成时间。在本文中,我们提出了一种P-MADDPG算法来解决紧急事件的紧急决策问题,该问题预测了下一次通过GRU模型在事件发生事件时可能发生事件的节点,并在事件发生之前做出决策,从而解决了决策速度无法跟上扩散速度的问题。为现实情况建立了一个模拟环境,并选择了三种场景来测试P-MADDPG在紧急决策问题中的紧急事件中的表现:无人储存,工厂装配线和民用机场行李运输。使用P-MADDPG算法的仿真结果与贪婪算法和MADDPG算法进行了比较,最终的实验结果表明,在不同尺寸的情况下,P-MADDPG算法收敛速度比其他算法更快,更好。这表明P-MADDP算法对于紧急事件中的紧急决策有效。

In recent years, human casualties and damage to resources caused by emergent incidents have become a serious problem worldwide. In this paper, we model the emergency decision-making problem and use Multi-agent System (MAS) to solve the problem that the decision speed cannot keep up with the spreading speed. MAS can play an important role in the automated execution of these tasks to reduce mission completion time. In this paper, we propose a P-MADDPG algorithm to solve the emergency decision-making problem of emergent incidents, which predicts the nodes where an incident may occur in the next time by GRU model and makes decisions before the incident occurs, thus solving the problem that the decision speed cannot keep up with the spreading speed. A simulation environment was established for realistic scenarios, and three scenarios were selected to test the performance of P-MADDPG in emergency decision-making problems for emergent incidents: unmanned storage, factory assembly line, and civil airport baggage transportation. Simulation results using the P-MADDPG algorithm are compared with the greedy algorithm and the MADDPG algorithm, and the final experimental results show that the P-MADDPG algorithm converges faster and better than the other algorithms in scenarios of different sizes. This shows that the P-MADDP algorithm is effective for emergency decision-making in emergent incident.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源