论文标题
在多代理系统中探索以任务为导向的通信:一种深入的增强学习方法
Exploring Task-oriented Communication in Multi-agent System: A Deep Reinforcement Learning Approach
论文作者
论文摘要
多代理系统(MAS)可以在代理之间共享功能,从而可以通过高可扩展性和效率来完成协作任务。 MAS越来越广泛地应用于各个领域。同时,代理之间的大规模和时间敏感的数据传输给通信系统带来了挑战。传统的无线通信忽略了数据的内容及其对接收器任务执行的影响,这使得很难确保信息的及时性和相关性。这种限制导致传统的无线沟通努力,以有效地支持新兴的多代理协作应用程序。面对这种困境,以任务为导向的通信是一种潜在的解决方案,该解决方案旨在传输与任务相关的信息以提高任务执行绩效。但是,多代理协作本身是一系列复杂的顺序决策问题。在这种情况下探索有效的信息流是一项挑战。在本文中,我们使用深度强化学习(DRL)来探索MAS中面向任务的交流。我们首先讨论DRL在以任务为导向的通信中的应用。然后,我们设想了MAS的面向任务的通信体系结构,并讨论基于DRL的设计。最后,我们讨论了未来研究的开放问题,并综述了本文。
The multi-agent system (MAS) enables the sharing of capabilities among agents, such that collaborative tasks can be accomplished with high scalability and efficiency. MAS is increasingly widely applied in various fields. Meanwhile, the large-scale and time-sensitive data transmission between agents brings challenges to the communication system. The traditional wireless communication ignores the content of the data and its impact on the task execution at the receiver, which makes it difficult to guarantee the timeliness and relevance of the information. This limitation leads to that traditional wireless communication struggles to effectively support emerging multi-agent collaborative applications. Faced with this dilemma, task-oriented communication is a potential solution, which aims to transmit task-relevant information to improve task execution performance. However, multi-agent collaboration itself is a complex class of sequential decision problems. It is challenging to explore efficient information flow in this context. In this article, we use deep reinforcement learning (DRL) to explore task-oriented communication in MAS. We begin with a discussion on the application of DRL to task-oriented communication. We then envision a task-oriented communication architecture for MAS, and discuss the designs based on DRL. Finally, we discuss open problems for future research and conclude this article.