论文标题
FedVMR:一种新的联合学习方法,用于检索视频时刻
FedVMR: A New Federated Learning method for Video Moment Retrieval
论文作者
论文摘要
尽管取得了巨大的成功,但现有的视频力矩检索(VMR)方法还是在数据集中存储的假设下开发的。但是,在实际应用程序中,由于数据生成和隐私问题的固有性质,数据通常分布在不同的孤岛上,为有效的大规模培训带来了巨大的挑战。在这项工作中,我们试图通过利用联邦学习的最新成功来克服上述限制。作为在VMR字段中探索的第一个,新任务被定义为带有分布式数据的视频时刻检索。然后,提出了一种名为FedVMR的新型联合学习方法,以促进分散环境中VMR模型的大规模和安全培训。基准数据集的实验证明了其有效性。这项工作是在分散场景中实现安全有效的VMR培训的首次尝试,希望为在相关研究领域的进一步研究铺平道路。
Despite the great success achieved, existing video moment retrieval (VMR) methods are developed under the assumption that data are centralizedly stored. However, in real-world applications, due to the inherent nature of data generation and privacy concerns, data are often distributed on different silos, bringing huge challenges to effective large-scale training. In this work, we try to overcome above limitation by leveraging the recent success of federated learning. As the first that is explored in VMR field, the new task is defined as video moment retrieval with distributed data. Then, a novel federated learning method named FedVMR is proposed to facilitate large-scale and secure training of VMR models in decentralized environment. Experiments on benchmark datasets demonstrate its effectiveness. This work is the very first attempt to enable safe and efficient VMR training in decentralized scene, which is hoped to pave the way for further study in the related research field.