论文标题

调整远程立体声匹配的偏见:语义指导方法

Adjusting Bias in Long Range Stereo Matching: A semantics guided approach

论文作者

Chuah, WeiQin, Tennakoon, Ruwan, Hoseinnezhad, Reza, Bab-Hadiashar, Alireza, Suter, David

论文摘要

立体声视觉通常涉及像素对应关系的计算以及整流图像对之间差异的估计。在许多应用中,包括同时定位和映射(SLAM)和3D对象检测,主要需要差异来计算深度值,而深度估计的准确性通常比差异估计更引人注目。但是,差异估计的准确性并未直接转化为深度估计的准确性,尤其是对于遥远的对象。在基于学习的立体声系统的背景下,这主要是由于基于差异的损失函数和训练数据所施加的偏见。因此,学习算法通常会对前景对象产生不可靠的深度估计,尤其是在大距离〜($> 50 $ m)。为了解决这个问题,我们首先分析这些偏见的效果,然后分别提出一对基于深度的损失函数,以分别针对前景和背景。这些损失功能是可调的,可以平衡立体声学习算法的固有偏差。我们解决方案的功效通过了一系列广泛的实验证明,这些实验是针对最先进的。我们在Kitti〜2015 Benchmark上显示,我们提出的解决方案在差异和深度估计方面产生了可观的改善,尤其是对于位于50米以上的距离的物体,表现优于先前的最新水平,$ 10 \%$ $。

Stereo vision generally involves the computation of pixel correspondences and estimation of disparities between rectified image pairs. In many applications, including simultaneous localization and mapping (SLAM) and 3D object detection, the disparities are primarily needed to calculate depth values and the accuracy of depth estimation is often more compelling than disparity estimation. The accuracy of disparity estimation, however, does not directly translate to the accuracy of depth estimation, especially for faraway objects. In the context of learning-based stereo systems, this is largely due to biases imposed by the choices of the disparity-based loss function and the training data. Consequently, the learning algorithms often produce unreliable depth estimates of foreground objects, particularly at large distances~($>50$m). To resolve this issue, we first analyze the effect of those biases and then propose a pair of novel depth-based loss functions for foreground and background, separately. These loss functions are tunable and can balance the inherent bias of the stereo learning algorithms. The efficacy of our solution is demonstrated by an extensive set of experiments, which are benchmarked against state of the art. We show on KITTI~2015 benchmark that our proposed solution yields substantial improvements in disparity and depth estimation, particularly for objects located at distances beyond 50 meters, outperforming the previous state of the art by $10\%$.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源