论文标题
任意样式转移和域概括的确切特征分布匹配
Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalization
论文作者
论文摘要
任意样式转移(AST)和域概括(DG)是重要但具有挑战性的视觉学习任务,可以将其作为功能分配匹配问题施放。假设高斯特征分布,常规特征分布匹配方法通常与特征的平均值和标准偏差相匹配。但是,现实世界数据的特征分布通常比高斯更为复杂,高斯无法通过仅使用一阶和二阶统计数据来准确匹配,而它在计算上使用高阶统计来进行分布匹配的情况效率很高。在这项工作中,我们首次提议通过与图像特征的经验累积分布函数(ECDF)进行匹配,以执行精确的特征分布匹配(EFDM),这可以通过在图像特征空间中应用确切的直方图匹配(EHM)来实现。尤其是,一种名为“排序匹配”的快速EHM算法以最低的成本以插件的方式执行EFDM。我们提出的EFDM方法的有效性在各种AST和DG任务上得到了验证,这证明了新的最新结果。代码可在https://github.com/ybzh/efdm上找到。
Arbitrary style transfer (AST) and domain generalization (DG) are important yet challenging visual learning tasks, which can be cast as a feature distribution matching problem. With the assumption of Gaussian feature distribution, conventional feature distribution matching methods usually match the mean and standard deviation of features. However, the feature distributions of real-world data are usually much more complicated than Gaussian, which cannot be accurately matched by using only the first-order and second-order statistics, while it is computationally prohibitive to use high-order statistics for distribution matching. In this work, we, for the first time to our best knowledge, propose to perform Exact Feature Distribution Matching (EFDM) by exactly matching the empirical Cumulative Distribution Functions (eCDFs) of image features, which could be implemented by applying the Exact Histogram Matching (EHM) in the image feature space. Particularly, a fast EHM algorithm, named Sort-Matching, is employed to perform EFDM in a plug-and-play manner with minimal cost. The effectiveness of our proposed EFDM method is verified on a variety of AST and DG tasks, demonstrating new state-of-the-art results. Codes are available at https://github.com/YBZh/EFDM.