论文标题

补丁程序:基于补丁的可推广深层隐式3D形状表示

PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations

论文作者

Tretschk, Edgar, Tewari, Ayush, Golyanik, Vladislav, Zollhöfer, Michael, Stoll, Carsten, Theobalt, Christian

论文摘要

隐式表面表示,例如签名距离函数,结合深度学习导致了令人印象深刻的模型,可以代表具有任意拓扑的对象的详细形状。由于学习了连续的函数,因此还可以在任何任意分辨率下提取重建。但是,需要大型数据集(例如Shapenet)才能训练此类型号。在本文中,我们提出了一个新的基于中层斑块的表面表示。在补丁级别,不同类别的对象具有相似性,这会导致更具概括的模型。然后,我们引入了一种新颖的方法,以在规范空间中学习这种基于贴片的表示形式,以便它尽可能地对象敏捷。我们表明,在Shapenet上对一类对象训练的表示形式也可以很好地代表来自任何其他类别的详细形状。此外,与现有方法相比,它可以使用较少的形状进行培训。我们显示了新表示形式的几个应用,包括形状插值和部分点云完成。由于对位置,定向和贴片比例的明确控制,与对象级表示相比,我们的表示也更具控制性,这使我们能够非辅助形状变形编码形状。

Implicit surface representations, such as signed-distance functions, combined with deep learning have led to impressive models which can represent detailed shapes of objects with arbitrary topology. Since a continuous function is learned, the reconstructions can also be extracted at any arbitrary resolution. However, large datasets such as ShapeNet are required to train such models. In this paper, we present a new mid-level patch-based surface representation. At the level of patches, objects across different categories share similarities, which leads to more generalizable models. We then introduce a novel method to learn this patch-based representation in a canonical space, such that it is as object-agnostic as possible. We show that our representation trained on one category of objects from ShapeNet can also well represent detailed shapes from any other category. In addition, it can be trained using much fewer shapes, compared to existing approaches. We show several applications of our new representation, including shape interpolation and partial point cloud completion. Due to explicit control over positions, orientations and scales of patches, our representation is also more controllable compared to object-level representations, which enables us to deform encoded shapes non-rigidly.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源