论文标题
莫奈:基于运动的点云预测网络
MoNet: Motion-based Point Cloud Prediction Network
论文作者
论文摘要
预测未来可以显着提高智能车辆的安全性,这是自动驾驶中的关键组成部分。 3D点云准确地模拟了周围环境的3D信息,并且对于智能车辆感知现场至关重要。因此,对3D点云的预测对智能车辆具有重要意义,可以将其用于众多进一步的应用。但是,由于点云是无序和非结构化的,因此点云预测具有挑战性,在当前文献中尚未深入探索。在本文中,我们提出了一个名为Monet的新型基于运动的神经网络。提出的莫奈的关键思想是将两个连续点云之间的运动特征整合到预测管道中。运动功能的引入使模型能够更准确地捕获跨帧的运动信息的变化,从而为将来的运动做出更好的预测。此外,引入内容功能以建模单个点云的空间内容。提出了一个复发性神经网络,以捕获这两个特征的时间相关性。此外,我们提出了一个基于注意力的运动对齐模块,以解决推理管道中缺少运动特征的问题。在两个大规模的室外激光雷达数据集上进行了广泛的实验证明了拟议的莫奈的性能。此外,我们使用预测的点云对应用进行实验,结果表明该方法的应用潜力很大。
Predicting the future can significantly improve the safety of intelligent vehicles, which is a key component in autonomous driving. 3D point clouds accurately model 3D information of surrounding environment and are crucial for intelligent vehicles to perceive the scene. Therefore, prediction of 3D point clouds has great significance for intelligent vehicles, which can be utilized for numerous further applications. However, due to point clouds are unordered and unstructured, point cloud prediction is challenging and has not been deeply explored in current literature. In this paper, we propose a novel motion-based neural network named MoNet. The key idea of the proposed MoNet is to integrate motion features between two consecutive point clouds into the prediction pipeline. The introduction of motion features enables the model to more accurately capture the variations of motion information across frames and thus make better predictions for future motion. In addition, content features are introduced to model the spatial content of individual point clouds. A recurrent neural network named MotionRNN is proposed to capture the temporal correlations of both features. Besides, we propose an attention-based motion align module to address the problem of missing motion features in the inference pipeline. Extensive experiments on two large scale outdoor LiDAR datasets demonstrate the performance of the proposed MoNet. Moreover, we perform experiments on applications using the predicted point clouds and the results indicate the great application potential of the proposed method.