论文标题
中性面部游戏角色通过pokerface-gan自动创造
Neutral Face Game Character Auto-Creation via PokerFace-GAN
论文作者
论文摘要
游戏角色自定义是许多最近的角色扮演游戏(RPG)的核心特征之一,玩家可以在其中编辑自己的游戏中角色的外观。本文研究了用一张照片自动创建游戏中字符的问题。在有关该主题的最新文献中,引入了神经网络,以使游戏引擎可区分,并使用自我监管的学习来预测面部定制参数。但是,在以前的方法中,表达参数和面部身份参数彼此高度耦合,因此很难对角色的内在面部特征进行建模。此外,在先前方法中使用的基于神经网络的渲染器也很难扩展到多视图渲染案例。在本文中,考虑到上述问题,我们提出了一种名为“ pokerface-gan”的新方法,用于中性面部游戏角色自动创造。我们首先构建一个可区分的字符渲染器,该渲染器比多视图渲染案例中的先前方法更灵活。然后,我们利用对抗性训练有效地将表达参数从身份参数中解散,从而生成玩家偏爱的中性面(无表达式)字符。由于我们方法的所有组成部分都是可区分的,因此我们的方法可以在多任务自我监督的学习范式下轻松训练。实验结果表明,我们的方法可以生成与输入照片高度相似的生动中性面部游戏字符。通过比较结果和消融研究来验证我们方法的有效性。
Game character customization is one of the core features of many recent Role-Playing Games (RPGs), where players can edit the appearance of their in-game characters with their preferences. This paper studies the problem of automatically creating in-game characters with a single photo. In recent literature on this topic, neural networks are introduced to make game engine differentiable and the self-supervised learning is used to predict facial customization parameters. However, in previous methods, the expression parameters and facial identity parameters are highly coupled with each other, making it difficult to model the intrinsic facial features of the character. Besides, the neural network based renderer used in previous methods is also difficult to be extended to multi-view rendering cases. In this paper, considering the above problems, we propose a novel method named "PokerFace-GAN" for neutral face game character auto-creation. We first build a differentiable character renderer which is more flexible than the previous methods in multi-view rendering cases. We then take advantage of the adversarial training to effectively disentangle the expression parameters from the identity parameters and thus generate player-preferred neutral face (expression-less) characters. Since all components of our method are differentiable, our method can be easily trained under a multi-task self-supervised learning paradigm. Experiment results show that our method can generate vivid neutral face game characters that are highly similar to the input photos. The effectiveness of our method is verified by comparison results and ablation studies.