论文标题
Shufflemixer:图像超分辨率的有效弯曲
ShuffleMixer: An Efficient ConvNet for Image Super-Resolution
论文作者
论文摘要
轻巧和效率是图像超分辨率(SR)算法实际应用的关键驱动因素。我们提出了一种简单有效的方法,即Shufflemixer,用于轻巧的图像超分辨率,探索大型卷积和频道拆分操作。与以前的SR模型相反,SR模型仅堆叠多个小内核卷积或复杂的操作员来学习表示形式,我们探索了一个大型内核转弯,用于移动友好的SR设计。具体而言,我们基于通道拆分和改组作为有效混合特征的基本组件,开发出大的深度卷积和两个投影层。由于自然图像的上下文在局部密切相关,因此仅使用大深度卷积不足以重建细节。为了在维持所提出的模块的效率的同时克服这个问题,我们将融合的MBCONV引入提出的网络中,以模拟不同特征的局部连接。实验结果表明,在模型参数和拖鞋方面,提出的Shufflemixer在实现竞争性能的同时,比最先进的方法小约6倍。在NTIRE 2022中,我们的主要方法赢得了有效的超分辨率挑战的模型复杂性轨迹[23]。该代码可从https://github.com/sunny2109/mobilesr-ntire2022获得。
Lightweight and efficiency are critical drivers for the practical application of image super-resolution (SR) algorithms. We propose a simple and effective approach, ShuffleMixer, for lightweight image super-resolution that explores large convolution and channel split-shuffle operation. In contrast to previous SR models that simply stack multiple small kernel convolutions or complex operators to learn representations, we explore a large kernel ConvNet for mobile-friendly SR design. Specifically, we develop a large depth-wise convolution and two projection layers based on channel splitting and shuffling as the basic component to mix features efficiently. Since the contexts of natural images are strongly locally correlated, using large depth-wise convolutions only is insufficient to reconstruct fine details. To overcome this problem while maintaining the efficiency of the proposed module, we introduce Fused-MBConvs into the proposed network to model the local connectivity of different features. Experimental results demonstrate that the proposed ShuffleMixer is about 6x smaller than the state-of-the-art methods in terms of model parameters and FLOPs while achieving competitive performance. In NTIRE 2022, our primary method won the model complexity track of the Efficient Super-Resolution Challenge [23]. The code is available at https://github.com/sunny2109/MobileSR-NTIRE2022.