论文标题
测试时间适应与形状矩进行图像分割
Test-Time Adaptation with Shape Moments for Image Segmentation
论文作者
论文摘要
有监督的学习是众所周知的,在分配变化的概括方面失败了。在典型的临床环境中,源数据无法访问,目标分布用少数样本表示:只有在几个或什至一个主题上进行适应时间才能在测试时间发生。我们研究了测试时间单项适应以进行分割,并提出了一个形状引导的熵最小化目标,以解决此任务。在对单个测试主题的推断期间,就批处理标准的量表和偏置参数而言,我们的损失被最小化。我们展示了整合各种形状先验以指导适应合理溶液的潜力,并在两个具有挑战性的情况下验证我们的方法:心脏分割的MRI-至CT适应和前列腺分割的跨站点适应。我们的方法表现出比现有的测试时间适应方法更好的表现。更令人惊讶的是,它比最新的域适应方法要好得多,尽管它在适应过程中放弃了对其他目标数据的培训。我们的结果质疑培训对目标数据在分割适应中的有用性,并指出了形状先验对测试时间推断的实质影响。我们的框架可以很容易地用于集成各种先验和适应任何细分网络,并且我们的代码可用。
Supervised learning is well-known to fail at generalization under distribution shifts. In typical clinical settings, the source data is inaccessible and the target distribution is represented with a handful of samples: adaptation can only happen at test time on a few or even a single subject(s). We investigate test-time single-subject adaptation for segmentation, and propose a Shape-guided Entropy Minimization objective for tackling this task. During inference for a single testing subject, our loss is minimized with respect to the batch normalization's scale and bias parameters. We show the potential of integrating various shape priors to guide adaptation to plausible solutions, and validate our method in two challenging scenarios: MRI-to-CT adaptation of cardiac segmentation and cross-site adaptation of prostate segmentation. Our approach exhibits substantially better performances than the existing test-time adaptation methods. Even more surprisingly, it fares better than state-of-the-art domain adaptation methods, although it forgoes training on additional target data during adaptation. Our results question the usefulness of training on target data in segmentation adaptation, and points to the substantial effect of shape priors on test-time inference. Our framework can be readily used for integrating various priors and for adapting any segmentation network, and our code is available.