论文标题
动态MMWave网络中自适应用户协会的多代理增强学习
Multi-Agent Reinforcement Learning for Adaptive User Association in Dynamic mmWave Networks
论文作者
论文摘要
网络致密和毫米波技术是满足移动网络第五代(5G)的能力和数据速率要求的关键推动力。在这种情况下,通过本地观察设计低复杂性策略,但能够针对全球网络状态和网络动态改编用户关联是一个挑战。实际上,文献中提出的框架需要连续访问全球网络信息,并在无线电环境变化时重新计算关联。由于与这种方法相关的复杂性,这些解决方案不太适合致密的5G网络。在本文中,我们通过基于多代理强化学习设计可扩展且灵活的算法来解决此问题。在这种方法中,用户充当独立的代理,仅基于其本地观察结果,就会学会自主协调其操作,以优化网络总数。由于代理之间没有直接的信息交换,因此我们还限制了信号开销。仿真结果表明,所提出的算法能够适应无线电环境的(快速)变化,因此与最先进的解决方案相比,可提供大量的汇率增益。
Network densification and millimeter-wave technologies are key enablers to fulfill the capacity and data rate requirements of the fifth generation (5G) of mobile networks. In this context, designing low-complexity policies with local observations, yet able to adapt the user association with respect to the global network state and to the network dynamics is a challenge. In fact, the frameworks proposed in literature require continuous access to global network information and to recompute the association when the radio environment changes. With the complexity associated to such an approach, these solutions are not well suited to dense 5G networks. In this paper, we address this issue by designing a scalable and flexible algorithm for user association based on multi-agent reinforcement learning. In this approach, users act as independent agents that, based on their local observations only, learn to autonomously coordinate their actions in order to optimize the network sum-rate. Since there is no direct information exchange among the agents, we also limit the signaling overhead. Simulation results show that the proposed algorithm is able to adapt to (fast) changes of radio environment, thus providing large sum-rate gain in comparison to state-of-the-art solutions.