论文标题
用于协作排队代理的图形卷积加强学习
Graph Convolutional Reinforcement Learning for Collaborative Queuing Agents
论文作者
论文摘要
在本文中,我们探讨了多学院深度学习的使用以及学习合作的原则,以在吞吐量和端到端延迟方面达到一系列分类网络流,以满足严格的服务水平协议。我们认为代理在加权的公平排队算法之上,该算法不断为三个流动组设定权重:金,银和青铜。我们依靠一种基于图形卷积的新型,多代理增强学习方法称为DGN。作为基准,我们提出了集中和分发深入的Q-Network方法,并评估其在不同网络,流量和路由方案中的表现,突出了我们的建议的有效性以及代理合作的重要性。我们表明,基于DGN的方法在所有情况下都符合严格的吞吐量和延迟要求。
In this paper, we explore the use of multi-agent deep learning as well as learning to cooperate principles to meet stringent service level agreements, in terms of throughput and end-to-end delay, for a set of classified network flows. We consider agents built on top of a weighted fair queuing algorithm that continuously set weights for three flow groups: gold, silver, and bronze. We rely on a novel graph-convolution based, multi-agent reinforcement learning approach known as DGN. As benchmarks, we propose centralized and distributed deep Q-network approaches and evaluate their performances in different network, traffic, and routing scenarios, highlighting the effectiveness of our proposals and the importance of agent cooperation. We show that our DGN-based approach meets stringent throughput and delay requirements across all scenarios.