论文标题
AFFED-协议分析
AFAFed -- Protocol analysis
论文作者
论文摘要
在本文中,我们设计,分析收敛属性并解决了截肢的实现方面。这是一个新颖的异步公平自适应联合学习框架,用于溪流的物联网应用环境,随着时间变化的操作条件,异质资源有限的设备(即同事),非I.I.I.D。本地培训数据和不可靠的通信链接。 AFFED的关键新事物是:(i)同事和中央服务器的两组适应性调谐的公差阈值和公平系数; (ii)分布式自适应机制,该机制使每个同事都可以自适应地调整自己的沟通率。 The convergence properties of AFAFed under (possibly) non-convex loss functions is guaranteed by a set of new analytical bounds, which formally unveil the impact on the resulting AFAFed convergence rate of a number of Federated Learning (FL) parameters, like, first and second moments of the per-coworker number of consecutive model updates, data skewness, communication packet-loss probability, and maximum/minimum values of the (自适应调谐)用于模型聚集的混合系数。
In this paper, we design, analyze the convergence properties and address the implementation aspects of AFAFed. This is a novel Asynchronous Fair Adaptive Federated learning framework for stream-oriented IoT application environments, which are featured by time-varying operating conditions, heterogeneous resource-limited devices (i.e., coworkers), non-i.i.d. local training data and unreliable communication links. The key new of AFAFed is the synergic co-design of: (i) two sets of adaptively tuned tolerance thresholds and fairness coefficients at the coworkers and central server, respectively; and, (ii) a distributed adaptive mechanism, which allows each coworker to adaptively tune own communication rate. The convergence properties of AFAFed under (possibly) non-convex loss functions is guaranteed by a set of new analytical bounds, which formally unveil the impact on the resulting AFAFed convergence rate of a number of Federated Learning (FL) parameters, like, first and second moments of the per-coworker number of consecutive model updates, data skewness, communication packet-loss probability, and maximum/minimum values of the (adaptively tuned) mixing coefficient used for model aggregation.