基于多尺度反向投影的图像超分辨率重建算法

doi:10.19678/j.issn.1000-3428.0055551

计算机工程 ›› 2020, Vol. 46 ›› Issue (7): 251-259. doi: 10.19678/j.issn.1000-3428.0055551

基于多尺度反向投影的图像超分辨率重建算法

熊亚辉^a,b, 陈东方^a,b, 王晓峰^a,b

武汉科技大学 a. 计算机科学与技术学院;b. 湖北省智能信息处理与实时工业系统重点实验室, 武汉 430065

收稿日期:2019-07-22 修回日期:2019-09-18 发布日期:2019-09-25
作者简介:熊亚辉(1994-),男,硕士研究生,主研方向为图像处理、超分辨率重建;陈东方,教授、博士;王晓峰,副教授、博士。
基金资助:
国家自然科学基金（61572381，61273225）。

Super-Resolution Image Reconstruction Algorithm Based on Multi-Scale Back Projection

XIONG Yahui^a,b, CHEN Dongfang^a,b, WANG Xiaofeng^a,b

a. School of Computer Science and Technology;b. Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan University of Science and Technology, Wuhan 430065, China

Received:2019-07-22 Revised:2019-09-18 Published:2019-09-25

摘要/Abstract

摘要： 为解决当前主流图像超分辨率重建算法对低分辨率图像中细节信息利用不够充分的问题，提出一种基于多尺度反向投影的图像超分辨率重建算法。使用多个不同尺度的卷积核从浅层特征提取层中提取出不同维度的特征信息，输入到反向投影模块后，交替使用升采样和降采样来优化高分辨率和低分辨率图像的投影误差，同时运用残差学习的思想将升采样和降采样阶段提取到的特征使用级联的方式进行连接，从而提升图像的重建效果。实验结果表明，在Set5、Set14和Urban100数据集上，与Bicubic、SRCNN、ESPCN、VDSR和LapSRN 5种主流算法相比，该算法的峰值信噪比和结构相似性均有所提高。

关键词: 图像超分辨率重建算法, 多尺度, 反向投影, 迭代式升采样和降采样, 深度学习

Abstract: In order to solve the problem that existing mainstream super-resolution image reconstruction algorithms fail to fully utilize the detailed information in Low-Resolution(LR) images,this paper proposes a super-resolution image reconstruction algorithm based on multi-scale back projection.The algorithm uses multiple convolutional kernels of different scales to extract feature information of different dimensions from the shallow feature extraction layer.Then the extracted feature information is input into the back projection module,and the upsampling and downsampling methods are used alternatively to optimize the projection error of High-Resolution(HR) and LR images.Also,the idea of residual learning is used to connect the features extracted in the upsampling and downsampling stages in a cascade manner,so as to improve the image reconstruction effect.Experimental results on the Set5,Set14 and Urban100 datasets show that the proposed algorithm improves the Peak Signal-to-Noise Ratio(PSNR) and Structural Similarity(SSIM) compared with the five mainstream algorithms such as Bicubic,SRCNN,ESPCN,VDSR and LapSRN.

Key words: super-resolution image reconstruction algorithm, multi-scale, back projection, iterative upsampling and downsampling, deep learning

中图分类号:

TP391

熊亚辉, 陈东方, 王晓峰. 基于多尺度反向投影的图像超分辨率重建算法[J]. 计算机工程, 2020, 46(7): 251-259.

XIONG Yahui, CHEN Dongfang, WANG Xiaofeng. Super-Resolution Image Reconstruction Algorithm Based on Multi-Scale Back Projection[J]. Computer Engineering, 2020, 46(7): 251-259.

http://www.ecice06.com/CN/Y2020/V46/I7/251

参考文献

[1] BATZ M,EICHENSEER A,SEILER J,et al.Hybrid super-resolution combining example-based single-image and interpolation-based multi-image reconstruction approaches[C]//Proceedings of 2015 IEEE International Conference on Image Processing.Washington D.C.,USA:IEEE Press,2015:58-62.
[2] YAO Xunxiang,ZHANG Yunfeng,NING Yang,et al.Multi-scale feature image interpolation based on a rational fractal function[J].Journal of Image and Graphics,2016,21(4):482-489.(in Chinese)姚勋祥,张云峰,宁阳,等.多尺度有理分形的图像插值算法[J].中国图象图形学报,2016,21(4):482-489.
[3] ZHANG Kaibing,GAO Xinbo,TAO Dacheng,et al.Single image super-resolution with non-local means and steering kernel regression[J].IEEE Transactions on Image Processing,2012,21(11):4544-4556.
[4] TAO Zhiqiang,LI Hailin,ZHANG Hongbing.Iterative back projection super resolution reconstruction algorithm based on new edge directed interpolation[J].Computer Engineering,2016,42(6):255-260.(in Chinese)陶志强,李海林,张红兵.基于新边缘指导插值的迭代反投影超分辨率重建算法[J].计算机工程,2016,42(6):255-260.
[5] TIMOFTE R,DE V,GOOL L V.Anchored neighborhood regression for fast example-based super-resolution[C]//Proceedings of 2013 IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2013:1920-1927.
[6] RADU T,VINCENT D S,LUC V G.A+:adjusted anchored neighborhood regression for fast super-resolution[C]//Proceedings of the 12th Asian Conference on Computer Vision.Berlin,Germany:Springer,2014:111-126.
[7] PELEG T,ELAD M.A statistical prediction model based on sparse representations for single image super-resolution[J].IEEE Transactions on Image Processing,2014,23(6):2569-2582.
[8] YANG J C,WRIGHT J,HUANG T S,et al.Image super-resolution via sparse representation[J].IEEE Transactions on Image Processing,2010,19(11):2861-2873.
[9] ZHANG Wanxu,SHI Jianxiong,CHEN Xiaoxuan,et al.Image super-resolution reconstruction based on sparse representation and guided filtering[J].Computer Engineering,2018,44(9):212-217.(in Chinese)张万绪,史剑雄,陈晓璇,等.基于稀疏表示与引导滤波的图像超分辨率重建[J].计算机工程,2018,44(9):212-217.
[10] YUAN Kunpeng,XI Zhihong.Image super resolution based on depth jumping cascade[J].Acta Optica Sinica,2019,39(7):243-252.(in Chinese)袁昆鹏,席志红.基于深度跳跃级联的图像超分辨率重建[J].光学学报,2019,39(7):243-252.
[11] HARIS M,SHAKHNAROVICH G,UKITA N.Deep back-projection networks for super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2018:1664-1673.
[12] WU Lei,LÜ Guoqiang,XUE Zhitian,et al.Super-resolution reconstruction of images based on multi-scale recursive network[J].Acta Optica Sinica,2019,39(6):90-97.(in Chinese)吴磊,吕国强,薛治天,等.基于多尺度递归网络的图像超分辨率重建[J].光学学报,2019,39(6):90-97.
[13] DONG C,LOY C C,HE K M,et al.Image super-resolution using deep convolutional networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,38(2):295-307.
[14] SHI W Z,CABALLERO J,HUSZAR F,et al.Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2016:1874-1883.
[15] KIM J,LEE J K,LEE K M.Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2016:1646-1654.
[16] LAI W S,HUANG J B,AHUJA N,et al.Deep laplacian pyramid networks for fast and accurate super-resolution[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2017:624-632.
[17] LAI Rui,YANG Yintang,ZHOU Huixin,et al.Total variation regularized iterative back-projection method for single frame image super resolution[C]//Proceedings of 2012 IEEE 11th International Conference on Signal Processing.Washington D.C.,USA:IEEE Press,2012:931-934.
[18] SZEGEDY C,LIU W,JIA Y Q,et al.Going deeper with convolutions[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2015:1-9.
[19] TIMOFTE R,AGUSTSSON E,GOOL L V,et al.Ntire 2017 challenge on single image super-resolution methods and results[C]//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops.Washington D.C.,USA:IEEE Press,2017:114-125.
[20] ZEYDE R,ELAD M,PROTTER M.On single image scale-up using sparse-representations[C]//Proceedings of International Conference on Curves and Surfaces.Berlin,Germany:Springer,2012:711-730.
[21] GLOROT X,BORDES A,BENGIO Y.Deep sparse rectifier neural networks[J].Journal of Machine Learning Research,2011,15:315-323.
[22] HUANG Yihui,FENG Qianjin.Segmentation of brain tumor on magnetic resonance images using 3D full-convolutional densely connected convolutional net-works[J].Journal of Southern Medical University,2018,38(6):661-668.

选择文件类型/文献管理软件名称

选择包含的内容

基于多尺度反向投影的图像超分辨率重建算法

Super-Resolution Image Reconstruction Algorithm Based on Multi-Scale Back Projection

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	江雨燕, 陶承凤, 李平. 数据增强和自适应自步学习的深度子空间聚类算法[J]. 计算机工程, 2023, 49(8): 96-103, 110.
[2]	宋志娜, 李莎, 杨建明, 徐川. 基于特征与区域定位增强的遥感舰船目标检测[J]. 计算机工程, 2023, 49(8): 257-264.
[3]	李泽水, 冀俊忠, 杨翠翠. 基于边权重信息深度网络嵌入的PPIN功能模块检测[J]. 计算机工程, 2023, 49(8): 69-76.
[4]	王可铮, 徐玉芬, 周尚波. 结合对比感知损失和融合注意力的图像去雾模型[J]. 计算机工程, 2023, 49(8): 207-214.
[5]	刘俊豪, 王美林, 谢兴, 宋烨兴, 许莉花. 基于改进YOLOv5的皮革瑕疵检测算法[J]. 计算机工程, 2023, 49(8): 240-249.
[6]	闫兴亚, 匡娅茜, 白光睿, 李月. 基于深度学习的学生课堂行为识别方法[J]. 计算机工程, 2023, 49(7): 251-258.
[7]	李军侠, 王星驰, 殷梓, 石德硕. 边缘深度挖掘的弱监督显著性目标检测[J]. 计算机工程, 2023, 49(7): 169-178.
[8]	吴珊, 周凤. 基于改进SSD算法的小目标检测[J]. 计算机工程, 2023, 49(7): 179-188.
[9]	席建锐, 唐红梅, 梁春阳, 刘鑫. 基于改进隐函数的点云物体重建[J]. 计算机工程, 2023, 49(7): 214-222.
[10]	王款, 宣士斌, 何雪东, 李紫薇, 李嘉祥. 基于交叉注意力Transformer的人体姿态估计方法[J]. 计算机工程, 2023, 49(7): 223-231.
[11]	齐咏生, 杜晓旭, 朱俊峰, 高胜利, 刘利强. 基于增强型轻量深度网络的牧区牲畜高效检测[J]. 计算机工程, 2023, 49(7): 278-287.
[12]	谌雨章, 黄逸姿, 张钧涵. 基于多速率空洞卷积的多尺度水下小目标检测[J]. 计算机工程, 2023, 49(6): 257-264.
[13]	熊中敏, 曾旗, 卢鹏, 王振华, 郑宗生. 基于残差注意力多尺度关系网络的逻辑推理[J]. 计算机工程, 2023, 49(6): 227-233,241.
[14]	张博旭, 蒲智, 程曦. 基于提示学习的维吾尔语文本分类研究[J]. 计算机工程, 2023, 49(6): 292-299,313.
[15]	于海洋, 景鹏, 张文涛, 谢赛飞, 滑志华, 宋草原. 基于残差与注意力机制的道路裂缝检测U-Net改进模型[J]. 计算机工程, 2023, 49(6): 265-273.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于多尺度反向投影的图像超分辨率重建算法

Super-Resolution Image Reconstruction Algorithm Based on Multi-Scale Back Projection

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价