论文标题

学习肖像样式表示

Learning Portrait Style Representations

论文作者

Shaik, Sadat, Bucher, Bernadette, Agrafiotis, Nephele, Phillips, Stephen, Daniilidis, Kostas, Schmenner, William

论文摘要

计算机视觉中艺术品的样式分析主要集中于通过优化对低水平样式特征(例如笔触)的理解来实现目标图像生成的结果。但是,从根本上需要不同的技术才能在计算上理解和控制具有更高级别样式特征的艺术质量。我们研究通过结合这些更高级别特征的神经网络体系结构学到的样式表示。我们发现,从合并由艺术史学家注释的三胞胎作为风格相似性的监督,我们发现了差异。利用统计先验或在图片集(例如ImageNet)上预估计的网络也可以得出有用的艺术品的视觉表示。我们使这些专家人类知识,统计和照片现实主义先验对风格表示的影响与艺术历史研究的风格表示,并利用这些表征对艺术家进行零拍的分类。为了促进这项工作,我们还介绍了准备计算分析的第一个大型肖像数据集。

Style analysis of artwork in computer vision predominantly focuses on achieving results in target image generation through optimizing understanding of low level style characteristics such as brush strokes. However, fundamentally different techniques are required to computationally understand and control qualities of art which incorporate higher level style characteristics. We study style representations learned by neural network architectures incorporating these higher level characteristics. We find variation in learned style features from incorporating triplets annotated by art historians as supervision for style similarity. Networks leveraging statistical priors or pretrained on photo collections such as ImageNet can also derive useful visual representations of artwork. We align the impact of these expert human knowledge, statistical, and photo realism priors on style representations with art historical research and use these representations to perform zero-shot classification of artists. To facilitate this work, we also present the first large-scale dataset of portraits prepared for computational analysis.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源