论文标题

用户辅助视频反射删除

User-assisted Video Reflection Removal

论文作者

Ahmed, Amgad, Kim, Suhong, Elgharib, Mohamed, Hefeeda, Mohamed

论文摘要

视频中的反射是当视频在玻璃等反射表面后面拍摄时经常发生的障碍。这些反思降低了此类视频的质量,导致信息丢失并降低许多计算机视觉算法的准确性。包含反射的视频是背景和反射层的组合。因此,反射去除等效于将视频分解为两层。但是,这是一个具有挑战性且不足的问题,因为有无数的有效分解。为了解决此问题,我们提出了一种用户辅助方法,以删除视频反射。我们依靠空间和时间信息,并利用稀疏的用户提示来帮助改善分离。提出方法的关键思想是使用运动提示在最小的用户帮助下将背景层与反射层分开。我们表明,用户辅助可显着改善层分离结果。我们通过对真实和合成视频的定量和定性结果来实施和评估所提出的方法。我们的实验表明,该提出的方法成功地从视频序列中删除了反射,不会引入视觉扭曲,并且显着优于文献中最新的反射删除方法。

Reflections in videos are obstructions that often occur when videos are taken behind reflective surfaces like glass. These reflections reduce the quality of such videos, lead to information loss and degrade the accuracy of many computer vision algorithms. A video containing reflections is a combination of background and reflection layers. Thus, reflection removal is equivalent to decomposing the video into two layers. This, however, is a challenging and ill-posed problem as there is an infinite number of valid decompositions. To address this problem, we propose a user-assisted method for video reflection removal. We rely on both spatial and temporal information and utilize sparse user hints to help improve separation. The key idea of the proposed method is to use motion cues to separate the background layer from the reflection layer with minimal user assistance. We show that user-assistance significantly improves the layer separation results. We implement and evaluate the proposed method through quantitative and qualitative results on real and synthetic videos. Our experiments show that the proposed method successfully removes reflection from video sequences, does not introduce visual distortions, and significantly outperforms the state-of-the-art reflection removal methods in the literature.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源