论文标题

用于模拟联合学习的快速收敛算法

Fast Convergence Algorithm for Analog Federated Learning

论文作者

Xia, Shuhao, Zhu, Jingyang, Yang, Yuhan, Zhou, Yong, Shi, Yuanming, Chen, Wei

论文摘要

在本文中,我们考虑了通过多个访问频道(MAC)的嘈杂淡出的联合学习(FL),其中边缘服务器汇总了通过空中计算(AIRCOMP)传输的多个端设备传输的本地模型。为了实现在无线通道上有效的模拟联合学习,我们提出了一种基于AIRCOMP的FEDSPLIT算法,其中采用了基于阈值的设备选择方案来实现可靠的本地模型上传。特别是,我们分析了提出的算法的性能,并证明所提出的算法在物镜强烈凸出且平稳的假设下将线性收敛到最佳溶液。我们还表征了提议的算法与条件不足的问题的鲁棒性,从而达到了快速的收敛速度并减少了通信回合。进一步提供有限误差,以揭示收敛行为与通道褪色和噪声之间的关系。与其他基准FL算法相比,我们的算法在理论上和实验上经过实验验证,对更快的问题的问题更为强大。

In this paper, we consider federated learning (FL) over a noisy fading multiple access channel (MAC), where an edge server aggregates the local models transmitted by multiple end devices through over-the-air computation (AirComp). To realize efficient analog federated learning over wireless channels, we propose an AirComp-based FedSplit algorithm, where a threshold-based device selection scheme is adopted to achieve reliable local model uploading. In particular, we analyze the performance of the proposed algorithm and prove that the proposed algorithm linearly converges to the optimal solutions under the assumption that the objective function is strongly convex and smooth. We also characterize the robustness of proposed algorithm to the ill-conditioned problems, thereby achieving fast convergence rates and reducing communication rounds. A finite error bound is further provided to reveal the relationship between the convergence behavior and the channel fading and noise. Our algorithm is theoretically and experimentally verified to be much more robust to the ill-conditioned problems with faster convergence compared with other benchmark FL algorithms.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源