中值直方图均衡的动态场景多曝光图像融合算法

doi:10.19678/j.issn.1000-3428.0062841

摘要/Abstract

摘要： 为解决动态场景下多曝光融合图像出现鬼影的问题，提出一种新的动态多曝光图像融合算法。引入中值图像均衡对输入图像和参考图像的直方图进行处理，将获取的图像对做差分，并对差分图进行阈值分割和形态学优化得到运动权重图。中值直方图均衡可以为一对图像分配相同的直方图，同时保持其灰度动态，因此对多曝光图像对调整其亮度差异，有利于运动区域检测的准确性。通过强度映射函数将参考图像分别映射为各个输入图像的亮度，并将输入图像的运动区域替换为参考图像的一部分，得到具有亮度过渡自然的图像序列。在此基础上，对静态图像序列进行融合得到最终的融合图像。实验结果表明，该算法可有效地避免鬼影现象，且能够获得细节丰富、视觉效果良好的高动态范围图像，经该算法融合后的图像在标准差、边缘强度、相关系数和动态场景结构一致4个指标上与DGF、FMSD等算法相比具有明显的优势。

关键词: 图像融合, 动态场景, 运动区域检测, 直方图匹配, 鬼影消除

Abstract: To solve the problem of ghosting in multi-exposure fusion images in dynamic scenes, this study proposes a dynamic multi-exposure image fusion algorithm with midway histogram equalization.First, Midway Image Equalization (MIE) is introduced to process the histograms of the input and reference images, the obtained image pairs are differentiated, and the difference image is subjected to threshold segmentation and morphological optimization to obtain a motion weight map.Midway histogram equalization can assign the same histogram to a pair of images while maintaining its gray dynamics as much as possible.Therefore, the brightness difference of a multi-exposure image pair can be adjusted, which is conducive to the accuracy of motion area detection.Second, an Intensity Mapping Function (IMF) is introduced to map the reference image to the brightness of each input image, and the motion area of the input image is replaced with a part of the reference image to obtain an image sequence with a natural brightness transition.Finally, the static image sequence is fused to obtain the final fused image.Experiments demonstrate that the algorithm can effectively avoid ghosting and obtain high-dynamic range images with rich details and good visual effects.In addition, images fused using this method have obvious advantages over the DGF and FMSD algorithms concerning standard deviation, edge strength, correlation coefficient, and dynamic scene structure.

Key words: image fusion, dynamic scene, motion region detection, histogram matching, ghost reduction

中图分类号:

TP391.41

王书朋, 贺瑞, 王瑜婧, 赵瑶. 中值直方图均衡的动态场景多曝光图像融合算法[J]. 计算机工程, 2022, 48(10): 224-229.

WANG Shupeng, HE Rui, WANG Yujing, ZHAO Yao. Multi-Exposure Image Fusion Algorithm for Dynamic Scene with Midway Histogram Equalization[J]. Computer Engineering, 2022, 48(10): 224-229.

http://www.ecice06.com/CN/Y2022/V48/I10/224

图/表 8

参考文献

[1] ZHANG X C.Benchmarking and comparing multi-exposure image fusion algorithms[J].Information Fusion, 2021, 74:111-131.
[2] NIE T, HUANG L, LIU H X, et al.Multi-exposure fusion of gray images under low illumination based on low-rank decomposition[J].Remote Sensing, 2021, 13(2):204.
[3] QI Y, ZHOU S B, ZHANG Z H, et al.Deep unsupervised learning based on color un-referenced loss functions for multi-exposure image fusion[J].Information Fusion, 2021, 66:18-39.
[4] 陈扬, 李大威.基于场景模态深度理解网络的单目图像深度理解[J].计算机工程, 2021, 47(2):268-278. CHEN Y, LI D W.Monocular image depth understanding based on scene modality depth understanding network[J].Computer Engineering, 2021, 47(2):268-278.(in Chinese)
[5] GALLO O, GELFANDZ N, CHEN W C, et al.Artifact-free high dynamic range imaging[C]//Proceedings of 2009 IEEE International Conference on Computational Photography.Washington D.C., USA:IEEE Press, 2009:1-7.
[6] LIU Y, WANG Z F.Dense SIFT for ghost-free multi-exposure fusion[J].Journal of Visual Communication and Image Representation, 2015, 31:208-224.
[7] PECE F, KAUTZ J.Bitmap movement detection:HDR for dynamic scenes[C]//Proceedings of 2010 International Conference on Visual Media Production.London, UK:[s.n.], 2010:1-8.
[8] HA H G, YUAN X, FIERRO M, et al.Ghost removal in exposure fusion by temporal consistency assessment[J].Journal of Imaging Science and Technology, 2016, 60(4):405-416.
[9] KALANTARI N K, RAMAMOORTHI R.Deep high dynamic range imaging of dynamic scenes[J].ACM Transactions on Graphics, 2017, 36(4):1-12.
[10] WU S Z, XU J R, TAI Y W, et al.Deep high dynamic range imaging with large foreground motions[C]//Proceedings of IEEE ECCV'18.Washington D.C., USA:IEEE Press, 2018:120-135.
[11] 王春智, 牛宏侠.基于直方图均衡化和MSRCR的沙尘降质图像增强算法[J/OL].计算机工程:1-8[2021-11-02].https://doi.org/10.19678/j.issn.1000-3428.0062764. WANG C Z, NIU H X.A sand-dust degraded image enhancement algorithm based on histogram equalization and MSRCR[J/OL].Computer Engineering:1-8[2021-11-02].https://doi.org/10.19678/j.issn.1000-3428.0062764. (in Chinese)
[12] DELON J.Midway image equalization[J].Journal of Mathematical Imaging and Vision, 2004, 21(2):119-134.
[13] OTSU N.A threshold selection method from gray-level histograms[J].IEEE Transactions on Systems, Man, and Cybernetics, 1979, 9(1):62-66.
[14] GROSSBERG M D, NAYAR S K.Determining the camera response from images:what is knowable?[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(11):1455-1467.
[15] MA K D, LI H, YONG H W, et al.Robust multi-exposure image fusion:a structural patch decomposition approach[J].IEEE Transactions on Image Processing, 2017, 26(5):2519-2532.
[16] LIU S G, ZHANG Y.Detail-preserving underexposed image enhancement via optimal weighted multi-exposure fusion[J].IEEE Transactions on Consumer Electronics, 2019, 65(3):303-311.
[17] LI S T, KANG X D.Fast multi-exposure image fusion with median filter and recursive filter[J].IEEE Transactions on Consumer Electronics, 2012, 58(2):626-632.
[18] HAYAT N, IMRAN M.Ghost-free multi exposure image fusion technique using dense SIFT descriptor and guided filter[J].Journal of Visual Communication and Image Representation, 2019, 62:295-308.
[19] LI H, MA K D, YONG H W, et al.Fast multi-scale structural patch decomposition for multi-exposure image fusion[J].IEEE Transactions on Image Processing, 2020, 29(2):5805-5816.
[20] QIN X M, SHEN J B, MAO X Y, et al.Robust match fusion using optimization[J].IEEE Transactions on Cybernetics, 2015, 45(8):1549-1560.
[21] LIU Y, LIU S P, WANG Z F.A general framework for image fusion based on multi-scale transform and sparse representation[J].Information Fusion, 2015, 24:147-164.
[22] 刘兆栋.基于稀疏表示理论的图像去噪与融合算法研究[D].重庆:重庆大学, 2016. LIU Z D.Research on image denoising and fusion based on sparse representation[D].Chongqing:Chongqing University, 2016.(in Chinese)
[23] DESHMUKH M, BHOSALE U.Image fusion and image quality assessment of fused images[J].International Journal of Image Processing, 2010, 4(5):484-508.
[24] FANG Y, ZHU H, MA K, et al.Perceptual evaluation for multi-exposure image fusion of dynamic scenes[J].IEEE Transactions on Image Processing, 2020, 29(5):1127-1138.

选择文件类型/文献管理软件名称

选择包含的内容