论文标题
深层超分辨率,通过迭代恢复与具有里程碑意义的估计之间的迭代合作
Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimation
论文作者
论文摘要
基于深度学习和面部先验的最新著作成功地超出了严重退化的面部图像。但是,在现有方法中并未完全利用先验知识,因为诸如里程碑和组件图等面部先验始终是通过低分辨率或超级分辨图像来估算的,这可能是不准确的,从而影响恢复性能。在本文中,我们提出了一种深层超分辨率(FSR)方法,并通过两个经常性网络之间的迭代协作分别着重于面部图像恢复和地标估计。在每个经常性步骤中,恢复分支都利用地标的先验知识产生更高质量的图像,从而有助于更准确的地标估计。因此,两个过程之间的迭代信息相互作用逐渐促进了彼此的性能。此外,一个新的细心融合模块旨在加强地标地图的指导,在该指导下,面部组件是单独和聚集的,以便更好地恢复。定量和定性实验结果表明,在恢复高质量的面部图像方面,所提出的方法显着优于最先进的FSR方法。
Recent works based on deep learning and facial priors have succeeded in super-resolving severely degraded facial images. However, the prior knowledge is not fully exploited in existing methods, since facial priors such as landmark and component maps are always estimated by low-resolution or coarsely super-resolved images, which may be inaccurate and thus affect the recovery performance. In this paper, we propose a deep face super-resolution (FSR) method with iterative collaboration between two recurrent networks which focus on facial image recovery and landmark estimation respectively. In each recurrent step, the recovery branch utilizes the prior knowledge of landmarks to yield higher-quality images which facilitate more accurate landmark estimation in turn. Therefore, the iterative information interaction between two processes boosts the performance of each other progressively. Moreover, a new attentive fusion module is designed to strengthen the guidance of landmark maps, where facial components are generated individually and aggregated attentively for better restoration. Quantitative and qualitative experimental results show the proposed method significantly outperforms state-of-the-art FSR methods in recovering high-quality face images.