论文标题
MDT-NET:通过感知监督在OCT扫描中对未配对图像的多域转移
MDT-Net: Multi-domain Transfer by Perceptual Supervision for Unpaired Images in OCT Scan
论文作者
论文摘要
深度学习模型在存在域变化的情况下往往不佳。域转移最近已成为一种有前途的方法,其中表现出域移位的图像被转化为其他域进行增强或适应。但是,由于没有配对和注释的图像,模型仅通过对抗性损失和循环一致性损失而学习,可能会导致翻译过程中解剖结构的一致性差。此外,学习多域转移的复杂性可以随着目标域和源图像的数量而显着增加。在本文中,我们提出了一个名为MDT-NET的多域转移网络,以通过感知监督来解决上述局限性。具体而言,我们的模型由一个单个编码器码头网络和多个特定域的传输模块,以解剖解剖含量和域方差的特征表示。由于这种体系结构,当在多个域之间进行翻译时,该模型可以显着降低复杂性。为了证明我们的方法的性能,我们对修饰进行定性和定量评估模型,一个OCT数据集包括在三种不同的扫描仪设备(域)中进行扫描。此外,我们将转移结果作为流体分割的其他培训数据,以间接证明我们的模型的优势,即在数据适应和增强的任务中。实验结果表明,我们的方法可以在这些分割任务中普遍改进,这证明了MDT-NET在多域转移中的有效性和效率。
Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or adaptation. However, with the absence of paired and annotated images, models merely learned by adversarial loss and cycle consistency loss could result in poor consistency of anatomy structures during the translation. Additionally, the complexity of learning multi-domain transfer could significantly increase with the number of target domains and source images. In this paper, we propose a multi-domain transfer network, named MDT-Net, to address the limitations above through perceptual supervision. Specifically, our model consists of a single encoder-decoder network and multiple domain-specific transfer modules to disentangle feature representations of the anatomy content and domain variance. Owing to this architecture, the model could significantly reduce the complexity when the translation is conducted among multiple domains. To demonstrate the performance of our method, we evaluate our model qualitatively and quantitatively on RETOUCH, an OCT dataset comprising scans from three different scanner devices (domains). Furthermore, we take the transfer results as additional training data for fluid segmentation to prove the advantage of our model indirectly, i.e., in the task of data adaptation and augmentation. Experimental results show that our method could bring universal improvement in these segmentation tasks, which demonstrates the effectiveness and efficiency of MDT-Net in multi-domain transfer.