论文标题
快速双层神经综合一击逼真的头像
Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars
论文作者
论文摘要
我们提出了一个基于神经渲染的系统，该系统从一张照片中创建头像。我们的方法将一个人的外观分解成两层，模拟了一个人的外观。第一层是由小神经网络合成的姿势依赖的粗图像。第二层由姿势独立的纹理图像定义，其中包含高频细节。质地图像是离线生成的，扭曲并添加到粗图像中，以确保高效分辨出合成的头部视图。在视觉质量和速度方面，我们将系统与类似的最新系统进行了比较。该实验显示出对给定的视觉质量的先前神经头像模型的明显推断速度。我们还报告了系统的基于实时智能手机的实现。
We propose a neural rendering-based system that creates head avatars from a single photograph. Our approach models a person's appearance by decomposing it into two layers. The first layer is a pose-dependent coarse image that is synthesized by a small neural network. The second layer is defined by a pose-independent texture image that contains high-frequency details. The texture image is generated offline, warped and added to the coarse image to ensure a high effective resolution of synthesized head views. We compare our system to analogous state-of-the-art systems in terms of visual quality and speed. The experiments show significant inference speedup over previous neural head avatar models for a given visual quality. We also report on a real-time smartphone-based implementation of our system.
