论文标题
在在线适应语义图像细分的道路上
On the Road to Online Adaptation for Semantic Image Segmentation
论文作者
论文摘要
我们提出了一个新的问题制定和相应的评估框架,以推动对语义图像分割的无监督域适应性的研究。总体目标是促进自适应学习系统的发展,这些系统将在不断变化的环境中不断学习,而无需监督。研究分割模型的适应算法的典型协议仅限于几个领域,脱机情况的适应性,通常需要人为干预,至少要注释数据以进行超参数调整。我们认为,这种约束与可以不断适应不同现实情况的算法不相容。为了解决这个问题,我们提出了一个协议,模型需要从在线相关的图像序列进行在线学习,需要连续的,逐帧的适应。我们伴随着新的协议,采用各种基准来解决拟议的配方,并对其行为进行广泛的分析,这可以作为未来研究的起点。
We propose a new problem formulation and a corresponding evaluation framework to advance research on unsupervised domain adaptation for semantic image segmentation. The overall goal is fostering the development of adaptive learning systems that will continuously learn, without supervision, in ever-changing environments. Typical protocols that study adaptation algorithms for segmentation models are limited to few domains, adaptation happens offline, and human intervention is generally required, at least to annotate data for hyper-parameter tuning. We argue that such constraints are incompatible with algorithms that can continuously adapt to different real-world situations. To address this, we propose a protocol where models need to learn online, from sequences of temporally correlated images, requiring continuous, frame-by-frame adaptation. We accompany this new protocol with a variety of baselines to tackle the proposed formulation, as well as an extensive analysis of their behaviors, which can serve as a starting point for future research.