Author Login Editor-in-Chief Peer Review Editor Work Office Work

Computer Engineering ›› 2021, Vol. 47 ›› Issue (9): 313-320. doi: 10.19678/j.issn.1000-3428.0058575

• Development Research and Engineering Application • Previous Articles    

Differentiable Neural Architecture Search Method for Blind Image Deblurring

MIAO Si, ZHU Yongxin   

  1. Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai 201210, China
  • Received:2020-06-08 Revised:2020-07-20 Published:2020-08-06

针对图像盲去模糊的可微分神经网络架构搜索方法

缪斯, 祝永新   

  1. 中国科学院上海高等研究院, 上海 201210
  • 作者简介:缪斯(1997-),男,硕士研究生,主研方向为深度学习,图像复原;祝永新(通信作者),研究员、博士。
  • 基金资助:
    国家自然科学基金(U1831118);国家重点研发计划(2019YFB2204204);中国科学院先导项目(XDC02070700);中国科学院院内人才项目(E052891ZZ1)。

Abstract: The design of neural networks for image deblurring requires heavy work of manual parameter tuning. To address the problem, a differentiable neural network search method for image deblurring is proposed. By designing a U-shaped residual search space, the search of image deblurring networks is simplified into the search of 9 search units. Besides, this paper presents an algorithm based on random walk and nearest-neighbor interpolation. The algorithm can generate blur kernels by simulating the camera motion trajectory, and thus provide enough blur images for training. The experimental results show that the proposed method significantly reduces the workload of manual tuning. The PSNR of the network obtained by the proposed method is 3.10 dB higher than that of UNet on the GOPRO data set and 1.17 dB on the Kohler dataset, while the inference speed of the network is close to that of UNet.

Key words: convolutional neural network, differentiable neural architecture search, image deblurring, image restoration, data augmentation

摘要: 为了解决设计图像去模糊神经网络依赖大量手工调参的问题,提出一种面向图像盲去模糊的可微分神经网络架构搜索方法。通过设计U型残差搜索空间,将去模糊网络的搜索过程分为9个搜索单元的搜索过程,降低了搜索的复杂度,并设计出一个基于随机游走和最近邻插值的算法,通过模拟相机运动轨迹的方式生成模糊核,进而生成足够的模糊图像用于训练。实验结果表明,该方法明显减少了人工调参的工作量,在GOPRO和Kohler数据集上搜索得到的网络,峰值信噪比相对于基准网络UNet分别提升3.10 dB和1.17 dB,并接近UNet的推理速度。

关键词: 卷积神经网络, 可微分神经网络架构搜索, 图像去模糊, 图像复原, 数据扩增

CLC Number: