论文标题
通过目标感知的双分支蒸馏进行跨域对象检测
Cross Domain Object Detection by Target-Perceived Dual Branch Distillation
论文作者
论文摘要
跨域对象检测是野外现实且具有挑战性的任务。由于数据分布的大变化以及目标域中缺乏实例级注释,因此其性能退化遭受了降解。现有方法主要集中于这两个困难中的任何一个,即使它们紧密耦合在跨域对象检测中。为了解决这个问题,我们提出了一个新颖的目标性双分支蒸馏(TDD)框架。通过在统一的教师学习方案中整合源和目标域的检测分支,它可以有效地减少域移动并产生可靠的监督。特别是,我们首先在两个域之间引入一个独特的目标建议感知器。它可以通过利用迭代跨注意的目标提案环境来自适应增强源检测器在目标图像中感知对象。之后,我们为模型培训设计了简洁的双分支自我蒸馏策略,该策略可以通过在两个分支中的自distillation来逐步整合来自不同领域的互补对象知识。最后,我们对跨域对象检测的许多广泛使用的场景进行了广泛的实验。结果表明,我们的TDD明显优于所有基准测试的最新方法。我们的代码和模型将在https://github.com/feobi1999/tdd上找到。
Cross domain object detection is a realistic and challenging task in the wild. It suffers from performance degradation due to large shift of data distributions and lack of instance-level annotations in the target domain. Existing approaches mainly focus on either of these two difficulties, even though they are closely coupled in cross domain object detection. To solve this problem, we propose a novel Target-perceived Dual-branch Distillation (TDD) framework. By integrating detection branches of both source and target domains in a unified teacher-student learning scheme, it can reduce domain shift and generate reliable supervision effectively. In particular, we first introduce a distinct Target Proposal Perceiver between two domains. It can adaptively enhance source detector to perceive objects in a target image, by leveraging target proposal contexts from iterative cross-attention. Afterwards, we design a concise Dual Branch Self Distillation strategy for model training, which can progressively integrate complementary object knowledge from different domains via self-distillation in two branches. Finally, we conduct extensive experiments on a number of widely-used scenarios in cross domain object detection. The results show that our TDD significantly outperforms the state-of-the-art methods on all the benchmarks. Our code and model will be available at https://github.com/Feobi1999/TDD.