论文标题

基于流数据的3D对象检测和跟踪

3D Object Detection and Tracking Based on Streaming Data

论文作者

Guo, Xusen, Gu, Jiangfeng, Guo, Silu, Xu, Zixiao, Yang, Chengzhang, Liu, Shanghua, Cheng, Long, Huang, Kai

论文摘要

由于深度学习的发展,3D对象检测的最新方法取得了巨大进展。但是,先前的研究主要基于单个框架,从而导致框架之间信息的利用有限。在本文中,我们试图利用流数据中的时间信息来探索基于3D流的对象检测和跟踪。为了实现此目标,我们设置了一个基于密钥帧的3D对象检测的双向网络,然后通过以时间信息为指导的基于运动的插值算法对非钥匙帧进行传播预测。与逐帧范式相比,我们的框架不仅显示出对物体检测的显着改进,而且还被证明可以在Kitti对象跟踪基准上产生竞争结果,而MOTA为76.68%,MOTP分别为81.65%。

Recent approaches for 3D object detection have made tremendous progresses due to the development of deep learning. However, previous researches are mostly based on individual frames, leading to limited exploitation of information between frames. In this paper, we attempt to leverage the temporal information in streaming data and explore 3D streaming based object detection as well as tracking. Toward this goal, we set up a dual-way network for 3D object detection based on keyframes, and then propagate predictions to non-key frames through a motion based interpolation algorithm guided by temporal information. Our framework is not only shown to have significant improvements on object detection compared with frame-by-frame paradigm, but also proven to produce competitive results on KITTI Object Tracking Benchmark, with 76.68% in MOTA and 81.65% in MOTP respectively.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源