论文标题

带基于流动的先验的盲图修复

Blind Image Restoration with Flow Based Priors

论文作者

Helminger, Leonhard, Bernasconi, Michael, Djelouah, Abdelaziz, Gross, Markus, Schroers, Christopher

论文摘要

由于深度神经网络的进步,在过去几年中,图像恢复取得了巨大进展。这些现有技术中的大多数都是使用适当的图像对进行培训的,以解决特定的降解。但是,在盲目的环境中,这是不可能的,这是不可能的,而且先验仍然至关重要。最近,已经提出了基于神经网络的方法来通过利用DeNo Autocododer或神经网络结构本身捕获的隐式正则化来对此类先验进行建模。与此相反,我们建议使用归一化的流对目标内容的分布进行建模,并将其用作最大后验(MAP)公式的先验。通过通过学到的徒图在潜在空间中表达MAP优化过程,我们可以通过梯度下降获得解决方案。据我们所知,这是第一项探讨图像增强问题的先验流量的正常化的工作。此外,我们在与深度图像先验方法相比时,为数据集的许多不同降解而呈现了许多不同的降解结果的实验​​结果。

Image restoration has seen great progress in the last years thanks to the advances in deep neural networks. Most of these existing techniques are trained using full supervision with suitable image pairs to tackle a specific degradation. However, in a blind setting with unknown degradations this is not possible and a good prior remains crucial. Recently, neural network based approaches have been proposed to model such priors by leveraging either denoising autoencoders or the implicit regularization captured by the neural network structure itself. In contrast to this, we propose using normalizing flows to model the distribution of the target content and to use this as a prior in a maximum a posteriori (MAP) formulation. By expressing the MAP optimization process in the latent space through the learned bijective mapping, we are able to obtain solutions through gradient descent. To the best of our knowledge, this is the first work that explores normalizing flows as prior in image enhancement problems. Furthermore, we present experimental results for a number of different degradations on data sets varying in complexity and show competitive results when comparing with the deep image prior approach.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源