融合深度学习与成像模型的水下图像增强算法

doi:10.19678/j.issn.1000-3428.0060653

计算机工程 ›› 2022, Vol. 48 ›› Issue (2): 243-249. doi: 10.19678/j.issn.1000-3428.0060653

融合深度学习与成像模型的水下图像增强算法

陈学磊¹, 张品², 权令伟¹, 易超¹, 鹿存跃¹

1. 上海交通大学电子信息与电气工程学院, 上海 200240;
2. 陆军工程大学电磁环境效应与光电工程国家级重点实验室, 南京 210007

收稿日期:2021-01-20 修回日期:2021-02-23 发布日期:2021-03-01
作者简介:陈学磊(1996-),男,硕士研究生,主研方向为水下图像处理;张品,博士;权令伟、易超,硕士研究生;鹿存跃,副教授。
基金资助:
国家自然科学基金面上项目（11174206）；上海交通大学深蓝计划重点项目（SL2020ZD103）。

Underwater Image Enhancement Algorithm Combining Deep Learning and Image Formation Model

CHEN Xuelei¹, ZHANG Pin², QUAN Lingwei¹, YI Chao¹, LU Cunyue¹

1. School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China;
2. National Key Laboratory on Electromagnetic Environmental Effects and Electro-optical Engineering, Army Engineering University of PLA, Nanjing 210007, China

Received:2021-01-20 Revised:2021-02-23 Published:2021-03-01

摘要/Abstract

摘要： 水下机器人的视觉感知功能因受到水下环境因素的影响，面临着图像质量降低的挑战，如图像颜色畸变、整体色调偏绿、偏蓝、对比度较低、细节较为模糊等。提出一种结合深度学习方法与物理成像模型的新型水下图像增强算法，通过构建包含扩张卷积和带参数激活函数的神经网络，进行背景散射光和直接传输映射的估计，并结合成像模型的数学表达进行重建运算得到增强后图像。实验结果表明，与UDCP、IBLA、GLNet等典型图像增强算法相比，该算法具有更快的运算速度，且能够消除水下环境因素带来的影响，丰富图像色彩的同时能增强各类细节，在峰值信噪比指标和结构相似度指标上取得了较大值。此外，增强后的图像在特征点匹配实验中获得了更好的匹配效果。

关键词: 深度学习, 成像模型, 图像增强, 水下机器人, 视觉感知

Abstract: The visual perception of underwater robots is affected by environmental factors, which reduce the quality of generated images.Those images usually face color distortion, low contrast and loss of details, and the hue of the images tends to be green or blue.In this paper, a new underwater image enhancement algorithm that combines deep learning with an image formation model is proposed.The proposed algorithm estimates backscatter and direct transmission by building neural networks which include dilated convolution and parametric rectified linear units.Then the enhanced images are obtained by using mathematical expressions of the image formation model for reconstruction calculations.Experimental results show that compared with UDCP, IBLA, GLNet and other image enhancement algorithms, the proposed method displays a higher calculation speed.It can eliminate the influence of underwater environmental factors, enrich the color of images, and enhance details.It achieves higher scores in Peak Signal-to-Noise Ratio(PSNR) and Structural SIMilarity (SSIM) metrics, and the enhanced images provide better results in feature point matching experiments.

Key words: deep learning, image formation model, image enhancement, underwater robots, visual perception

中图分类号:

TP391

陈学磊, 张品, 权令伟, 易超, 鹿存跃. 融合深度学习与成像模型的水下图像增强算法[J]. 计算机工程, 2022, 48(2): 243-249.

CHEN Xuelei, ZHANG Pin, QUAN Lingwei, YI Chao, LU Cunyue. Underwater Image Enhancement Algorithm Combining Deep Learning and Image Formation Model[J]. Computer Engineering, 2022, 48(2): 243-249.

http://www.ecice06.com/CN/Y2022/V48/I2/243

图/表 11

20220301181556

20220301181559

20220301181602

20220301181605

20220301181608

20220301181612

20220301181615

20220301181618

20220301181622

20220301181625

20220301181628

参考文献

[1] NARASIMHAN S G, NAYAR S K.Vision and the atmosphere[J].International Journal of Computer Vision, 2002, 48(3):233-254.
[2] DREWS J P, NASCIMENTO E, MORAES F, et al.Transmission estimation in underwater single images[C]//Proceedings of International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2013:825-830.
[3] PENG Y T, COSMAN P C.Underwater image restoration based on image blurriness and light absorption[J].IEEE Transactions on Image Processing, 2017, 26(4):1579-1594.
[4] 王红茹, 张弓, 卢道华, 等.基于背景光估计与颜色修正的水下图像增强[J].计算机工程, 2020, 46(10):253-258. WANG H R, ZHANG G, LU D H, et al.Underwater image enhancement based on background light estimation and color correction[J].Computer Engineering, 2020, 46(10):253-258.(in Chinese)
[5] AKKAYNAK D, TREIBITZ T.A revised underwater image formation model[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:6723-6732.
[6] KRIZHEVSKY A, SUTSKEVER I, HINTON G E.ImageNet classification with deep convolutional neural networks.[J].Communications of the ACM, 2017, 60(6):84-90.
[7] RUSSAKOVSKY O, DENG J, SU H, et al.ImageNet large scale visual recognition challenge[J].International Journal of Computer Vision, 2015, 115(3):211-252.
[8] LI C Y, GUO J C, GUO C L.Emerging from water:underwater image color correction based on weakly supervised color transfer[J].IEEE Signal Processing Letters, 2018, 25(3):323-327.
[9] SKINNER K A, ZHANG J M, OLSON E A, et al.UWStereoNet:unsupervised learning for depth estimation and color correction of underwater stereo imagery[C]//Proceedings of International Conference on Robotics and Automation.Washington D.C., USA:IEEE Press, 2019:7947-7954.
[10] FU X Y, CAO X Y.Underwater image enhancement with global-local networks and compressed-histogram equalization[J].Signal Processing:Image Communication, 2020, 86(11):92-110.
[11] HE K M, ZHANG X Y, REN S Q, et al.Delving deep into rectifiers:surpassing human-level performance on imagenet classification[C]//Proceedings of International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2015:1026-1034.
[12] WANG P Q, CHEN P F, YUAN Y, et al.Understanding convolution for semantic segmentation[C]//Proceedings of IEEE Winter Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2018:1451-1460.
[13] LI C Y, GUO C L, REN W Q, et al.An underwater image enhancement benchmark dataset and beyond[EB/OL].[2020-10-01].https://arxiv.org/abs/1901.05495.
[14] HITAM M S, AWALLUDIN E A, YUSSOF W N, et al.Mixture contrast limited adaptive histogram equalization for underwater image enhancement[C]//Proceedings of International Conference on Computer Applications Technology.Washington D.C., USA:IEEE Press, 2013:1-5.
[15] 张聿, 刘世光.基于分区曝光融合的不均匀亮度视频增强[J].计算机辅助设计与图形学学报, 2017, 29(12):2317-2322. ZHANG Y, LIU S G.Non-uniform illumination video enhancement based on zone system and fusion[J].Journal of Computer-Aided Design & Computer Graphics, 2017, 29(12):2317-2322.(in Chinese)
[16] LIU S G, ZHANG Y.Detail-preserving underexposed image enhancement via optimal weighted multi-exposure fusion[J].IEEE Transactions on Consumer Electronics, 2019, 65(3):303-311.
[17] 马春波, 赵兰兰, 敖珺, 等.基于B样条迭代配准的水下扭曲图像恢复算法[J].计算机工程, 2017, 43(5):224-228. MA C B, ZHAO L L, AO J, et al.Recovery algortithm of underwater distorted images based on B-spline iteration registration[J].Computer Engineering, 2017, 43(5):224-228.(in Chinese)
[18] KINGMA D P, BA J.Adam:a method for stochastic optimization[EB/OL].[2020-10-01].https://arxiv.org/abs/1412.6980v8.
[19] YANG M, SOWMYA A.An underwater color image quality evaluation metric[J].IEEE Transactions on Image Processing, 2015, 24(12):6062-6071.
[20] PANETTA K, GAO C, AGAIAN S.Human-visual-system-inspired underwater image quality measures[J].IEEE Journal of Oceanic Engineering, 2015, 41(3):541-551.
[21] LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision, 2004, 60(2):91-110.
[22] FISCHLER M A, BOLLES R C.Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J].Communications of the ACM, 1981, 24(6):381-395.

选择文件类型/文献管理软件名称

选择包含的内容

融合深度学习与成像模型的水下图像增强算法

Underwater Image Enhancement Algorithm Combining Deep Learning and Image Formation Model

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	江雨燕, 陶承凤, 李平. 数据增强和自适应自步学习的深度子空间聚类算法[J]. 计算机工程, 2023, 49(8): 96-103, 110.
[2]	王书朋, 何引弟. 融合特征注意力机制的非均匀光照图像增强算法[J]. 计算机工程, 2023, 49(8): 232-239.
[3]	李泽水, 冀俊忠, 杨翠翠. 基于边权重信息深度网络嵌入的PPIN功能模块检测[J]. 计算机工程, 2023, 49(8): 69-76.
[4]	王可铮, 徐玉芬, 周尚波. 结合对比感知损失和融合注意力的图像去雾模型[J]. 计算机工程, 2023, 49(8): 207-214.
[5]	刘俊豪, 王美林, 谢兴, 宋烨兴, 许莉花. 基于改进YOLOv5的皮革瑕疵检测算法[J]. 计算机工程, 2023, 49(8): 240-249.
[6]	闫兴亚, 匡娅茜, 白光睿, 李月. 基于深度学习的学生课堂行为识别方法[J]. 计算机工程, 2023, 49(7): 251-258.
[7]	李军侠, 王星驰, 殷梓, 石德硕. 边缘深度挖掘的弱监督显著性目标检测[J]. 计算机工程, 2023, 49(7): 169-178.
[8]	吴珊, 周凤. 基于改进SSD算法的小目标检测[J]. 计算机工程, 2023, 49(7): 179-188.
[9]	席建锐, 唐红梅, 梁春阳, 刘鑫. 基于改进隐函数的点云物体重建[J]. 计算机工程, 2023, 49(7): 214-222.
[10]	齐咏生, 杜晓旭, 朱俊峰, 高胜利, 刘利强. 基于增强型轻量深度网络的牧区牲畜高效检测[J]. 计算机工程, 2023, 49(7): 278-287.
[11]	谌雨章, 黄逸姿, 张钧涵. 基于多速率空洞卷积的多尺度水下小目标检测[J]. 计算机工程, 2023, 49(6): 257-264.
[12]	常戬, 刘鑫姝. 空间转换与自适应灰度校正的低照度图像增强[J]. 计算机工程, 2023, 49(6): 193-200,207.
[13]	张博旭, 蒲智, 程曦. 基于提示学习的维吾尔语文本分类研究[J]. 计算机工程, 2023, 49(6): 292-299,313.
[14]	于海洋, 景鹏, 张文涛, 谢赛飞, 滑志华, 宋草原. 基于残差与注意力机制的道路裂缝检测U-Net改进模型[J]. 计算机工程, 2023, 49(6): 265-273.
[15]	王爱玲, 马文臻, 邹自明, 钟佳. 基于领域自适应的卫星工程参数异常检测[J]. 计算机工程, 2023, 49(5): 29-37,47.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

融合深度学习与成像模型的水下图像增强算法

Underwater Image Enhancement Algorithm Combining Deep Learning and Image Formation Model

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 11

参考文献

相关文章 15

编辑推荐

Metrics

本文评价