论文标题

评论:3D点云上的深度学习

Review: deep learning on 3D point clouds

论文作者

Bello, Saifullahi Aminu, Yu, Shangshu, Wang, Cheng

论文摘要

点云是3D公制空间中定义的点集。点云已成为3D表示形式最重要的数据格式之一。由于LIDAR等采集设备的可用性增加,以及在机器人技术,自动驾驶,增强和虚拟现实等领域的应用增加,因此它的受欢迎程度越来越高。深度学习现在是计算机视觉中数据处理最强大的工具,成为分类,细分和检测等任务最喜欢的技术。虽然深度学习技术主要应用于具有结构化网格的数据,但另一方面,点云是非结构化的。点云的非结构化是利用深度学习直接具有挑战性的。较早的方法通过将点云预处理成结构化的网格格式来克服这一挑战,而计算成本增加或深度信息的损失。然而,最近,正在开发许多直接在Point Cloud上运行的最先进的深度学习技术。本文包含对最近最新的深度学习技术的调查,该技术主要集中在点云数据上。我们首先简要讨论直接在点云上使用深度学习时所面临的主要挑战,我们还简要讨论了以前的方法,这些方法通过将点云预先处理成结构化的网格来克服挑战。然后,我们回顾各种最新的深度学习方法,这些方法直接以其非结构化形式处理点云。我们介绍了流行的3D点云基准数据集。我们还进一步讨论了深度学习在流行的3D视觉任务中的应用,包括分类,细分和检测。

Point cloud is point sets defined in 3D metric space. Point cloud has become one of the most significant data format for 3D representation. Its gaining increased popularity as a result of increased availability of acquisition devices, such as LiDAR, as well as increased application in areas such as robotics, autonomous driving, augmented and virtual reality. Deep learning is now the most powerful tool for data processing in computer vision, becoming the most preferred technique for tasks such as classification, segmentation, and detection. While deep learning techniques are mainly applied to data with a structured grid, point cloud, on the other hand, is unstructured. The unstructuredness of point clouds makes use of deep learning for its processing directly very challenging. Earlier approaches overcome this challenge by preprocessing the point cloud into a structured grid format at the cost of increased computational cost or lost of depth information. Recently, however, many state-of-the-arts deep learning techniques that directly operate on point cloud are being developed. This paper contains a survey of the recent state-of-the-art deep learning techniques that mainly focused on point cloud data. We first briefly discussed the major challenges faced when using deep learning directly on point cloud, we also briefly discussed earlier approaches which overcome the challenges by preprocessing the point cloud into a structured grid. We then give the review of the various state-of-the-art deep learning approaches that directly process point cloud in its unstructured form. We introduced the popular 3D point cloud benchmark datasets. And we also further discussed the application of deep learning in popular 3D vision tasks including classification, segmentation and detection.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源