论文标题
文本/语音驱动的全身动画
Text/Speech-Driven Full-Body Animation
论文作者
论文摘要
由于电影和游戏的需求不断增长,综合3D Avatar动画最近引起了很多关注。在这项工作中,我们提出了一个可以生产的文本/语音驱动的全身动画合成系统。鉴于文本和相应的语音,我们的系统同时综合了面部和身体动画,然后将其皮肤并呈现以获得视频流输出。我们采用一种基于学习的方法来综合面部动画和一种基于图的方法来使身体动画,从而有效,稳健地生成高质量的头像动画。我们的结果表明,生成的化身动画是现实,多样性且与文本/语音相关的高度相关的。
Due to the increasing demand in films and games, synthesizing 3D avatar animation has attracted much attention recently. In this work, we present a production-ready text/speech-driven full-body animation synthesis system. Given the text and corresponding speech, our system synthesizes face and body animations simultaneously, which are then skinned and rendered to obtain a video stream output. We adopt a learning-based approach for synthesizing facial animation and a graph-based approach to animate the body, which generates high-quality avatar animation efficiently and robustly. Our results demonstrate the generated avatar animations are realistic, diverse and highly text/speech-correlated.