论文标题
PIFUHD:高分辨率3D人数数字化的多级像素对齐的隐式函数
PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
论文作者
论文摘要
基于图像的3D人类形状估计的最新进展是由深神经网络提供的代表能力的显着改善所驱动的。尽管当前的方法已经证明了现实世界中的潜力,但它们仍然无法产生以输入图像中经常存在的细节水平的重建。我们认为,这种限制主要构成了两个相互矛盾的要求。准确的预测需要较大的背景,但是精确的预测需要高分辨率。由于当前硬件中的内存限制,以前的方法倾向于将低分辨率图像作为覆盖大空间上下文的输入,因此产生较少的精确(或低分辨率)3D估计值。我们通过制定端到端可训练的多级体系结构来解决此限制。粗糙的水平以较低的分辨率观察整个图像,并着重于整体推理。这为良好的级别提供了上下文,通过观察高分辨率图像来估计高度详细的几何形状。我们证明,通过完全利用1K分辨率输入图像,我们的方法在单图像重建上的现有最新技术可显着优于现有的最新技术。
Recent advances in image-based 3D human shape estimation have been driven by the significant improvement in representation power afforded by deep neural networks. Although current approaches have demonstrated the potential in real world settings, they still fail to produce reconstructions with the level of detail often present in the input images. We argue that this limitation stems primarily form two conflicting requirements; accurate predictions require large context, but precise predictions require high resolution. Due to memory limitations in current hardware, previous approaches tend to take low resolution images as input to cover large spatial context, and produce less precise (or low resolution) 3D estimates as a result. We address this limitation by formulating a multi-level architecture that is end-to-end trainable. A coarse level observes the whole image at lower resolution and focuses on holistic reasoning. This provides context to an fine level which estimates highly detailed geometry by observing higher-resolution images. We demonstrate that our approach significantly outperforms existing state-of-the-art techniques on single image human shape reconstruction by fully leveraging 1k-resolution input images.