论文标题
蜂窝网络中基于意图的服务保证的多代理增强学习
Multi-agent reinforcement learning for intent-based service assurance in cellular networks
论文作者
论文摘要
最近,由于许多用例的性能要求严格,基于意图的管理员在电信网络中受到了良好关注。文献中的几种方法采用传统的闭环驱动方法来满足KPI的意图。但是,这些方法将每个闭环彼此独立,从而降低了综合性能。同样,这种现有方法不容易扩展。在许多领域,多机构增强学习(MARL)技术在许多领域都表现出了巨大的希望,在许多领域中,传统的闭环控制效果不足,通常用于循环之间的复杂协调和冲突管理。在这项工作中,我们提出了一种基于MARL的方法来实现基于意图的管理,而无需了解基础系统的模型。此外,当有矛盾的意图时,MARL代理可以通过优先考虑重要的KPI来促进循环,以合作和促进不相互作用的权衡。已经在网络模拟器上进行了实验,以优化三个服务的KPI。获得的结果表明,当资源有足够的资源或优先级时,当资源稀缺时,提出的系统的性能很好,并且能够实现所有现有意图。
Recently, intent-based management has received good attention in telecom networks owing to stringent performance requirements for many of the use cases. Several approaches in the literature employ traditional closed-loop driven methods to fulfill the intents on the KPIs. However, these methods consider every closed-loop independent of each other which degrades the combined performance. Also, such existing methods are not easily scalable. Multi-agent reinforcement learning (MARL) techniques have shown significant promise in many areas in which traditional closed-loop control falls short, typically for complex coordination and conflict management among loops. In this work, we propose a method based on MARL to achieve intent-based management without the need for knowing a model of the underlying system. Moreover, when there are conflicting intents, the MARL agents can implicitly incentivize the loops to cooperate and promote trade-offs, without human interaction, by prioritizing the important KPIs. Experiments have been performed on a network emulator for optimizing KPIs of three services. Results obtained demonstrate that the proposed system performs quite well and is able to fulfill all existing intents when there are enough resources or prioritize the KPIs when resources are scarce.