论文标题
3D iou-net:iou引导的3D对象检测器用于点云
3D IoU-Net: IoU Guided 3D Object Detector for Point Clouds
论文作者
论文摘要
大多数现有的基于点云的3D对象检测器都集中在分类和框回归的任务上。但是,该领域的另一个瓶颈是实现了非最大抑制(NMS)后处理的准确检测信心。在本文中,我们将3D IOU预测分支添加到常规分类和回归分支。预测的IO被用作NMS的检测置信度。为了获得更准确的IOU预测,我们建议使用IOU敏感功能学习和IOU对齐操作的3D IOU-NET。为了获得视角不变的预测头,我们通过从八个角度的每个角度汇总一个局部点云特征,并以不同的关注来适应每个视角的贡献,提出一个细心的角聚合(ACA)模块。我们提出了一个转角几何编码(CGE)模块,以嵌入几何信息。据我们所知,这是提案功能学习中首次引入几何嵌入信息。然后,这两个特征部分由多层感知器(MLP)网络自适应地融合,作为我们的敏感功能。引入了IOU对齐操作,以解决边界框回归头和IOU预测之间的不匹配,从而进一步提高了IOU预测的准确性。 KITTI CAR检测基准的实验结果表明,具有感知的3D IOU-NET实现了最先进的性能。
Most existing point cloud based 3D object detectors focus on the tasks of classification and box regression. However, another bottleneck in this area is achieving an accurate detection confidence for the Non-Maximum Suppression (NMS) post-processing. In this paper, we add a 3D IoU prediction branch to the regular classification and regression branches. The predicted IoU is used as the detection confidence for NMS. In order to obtain a more accurate IoU prediction, we propose a 3D IoU-Net with IoU sensitive feature learning and an IoU alignment operation. To obtain a perspective-invariant prediction head, we propose an Attentive Corner Aggregation (ACA) module by aggregating a local point cloud feature from each perspective of eight corners and adaptively weighting the contribution of each perspective with different attentions. We propose a Corner Geometry Encoding (CGE) module for geometry information embedding. To the best of our knowledge, this is the first time geometric embedding information has been introduced in proposal feature learning. These two feature parts are then adaptively fused by a multi-layer perceptron (MLP) network as our IoU sensitive feature. The IoU alignment operation is introduced to resolve the mismatching between the bounding box regression head and IoU prediction, thereby further enhancing the accuracy of IoU prediction. The experimental results on the KITTI car detection benchmark show that 3D IoU-Net with IoU perception achieves state-of-the-art performance.