论文标题

通过置换矩阵学习搜索密集的点对应关系

Searching Dense Point Correspondences via Permutation Matrix Learning

论文作者

Zhang, Zhiyuan, Sun, Jiadai, Dai, Yuchao, Fan, Bin, Liu, Qi

论文摘要

尽管3D点云数据已作为3D信号表达的一般形式获得了广泛的关注,但是将点云应用于3D形状之间致密的对应关系估计的任务尚未得到广泛研究。此外,即使在少数现有的基于3D点云的方法中,也是一个重要而广泛的原则,即。一对一的匹配,通常被忽略。作为回应,本文提出了一种基于端到端学习的新方法,以估计3D点云的致密对应关系,其中将点匹配的问题提出为零一个分配问题,以实现置换匹配的矩阵以实现一对一的原理。请注意,此任务问题的经典解决方案始终是不可差异的,这对于深度学习框架是致命的。因此,我们设计了一个特殊的匹配模块,该模块首先求解了双随机矩阵,然后将其投影到所需的置换矩阵中获得了近似解决方案。此外,为了确保端到端的学习和计算出的损失的准确性,我们计算了从学习的置换矩阵中的损失,但将梯度传播到双随机矩阵,这在向后传播过程中绕过了置换矩阵。我们的方法可以应用于非刚性和刚性3D点云数据,并且广泛的实验表明,我们的方法可实现浓密的对应学习的最新性能。

Although 3D point cloud data has received widespread attentions as a general form of 3D signal expression, applying point clouds to the task of dense correspondence estimation between 3D shapes has not been investigated widely. Furthermore, even in the few existing 3D point cloud-based methods, an important and widely acknowledged principle, i.e . one-to-one matching, is usually ignored. In response, this paper presents a novel end-to-end learning-based method to estimate the dense correspondence of 3D point clouds, in which the problem of point matching is formulated as a zero-one assignment problem to achieve a permutation matching matrix to implement the one-to-one principle fundamentally. Note that the classical solutions of this assignment problem are always non-differentiable, which is fatal for deep learning frameworks. Thus we design a special matching module, which solves a doubly stochastic matrix at first and then projects this obtained approximate solution to the desired permutation matrix. Moreover, to guarantee end-to-end learning and the accuracy of the calculated loss, we calculate the loss from the learned permutation matrix but propagate the gradient to the doubly stochastic matrix directly which bypasses the permutation matrix during the backward propagation. Our method can be applied to both non-rigid and rigid 3D point cloud data and extensive experiments show that our method achieves state-of-the-art performance for dense correspondence learning.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源