Moire Fringe Elimination Algorithm Based on Second-order Newton Interpolation

doi:10.19678/j.issn.1000-3428.0054708

Abstract

Abstract: Digital camera tends to be disturbed by regular patterns of Color Filter Array(CFA) sampling frequency,leading to Moire fringes in output images.To solve the problem,this paper proposes a Moire fringe elimination algorithm based on second-order Newton interpolation approximation for digital images.The algorithm uses wavelet transform to extract the high frequency information of G component in horizontal and vertical directions,and implements frequency domain transformation on the high frequency information to simulate aliasing process of CFA.The Moire region and its potential region in the image are detected.Then,for the detected Moire regions,the second-order Newton interpolation is used to obtain the estimated value of G component in each direction,and the estimated values are weighted and averaged to recover the lost G component.With the assistance of color difference space model interpolation,the lost R and B componentsare recovered to obtain the final image with full RGB information and without Moire fringes.Experimental results show that the proposed algorithm can effectively eliminate Moire fringes without causing any damage to the color quality of the image.Also,the proposed algorithm has higher Peak Signal to Noise Ratio(PSNR) of recovered images than bilinear interpolation,Hibbard and other algorithms,and has better subjective visual effects.

Key words: Moire fringe, wavelet transform, frequency domain transform, second-order Newton interpolation, color difference space, Peak Signal to Noise Ratio(PSNR)

摘要： 数码相机拍摄容易受到颜色滤波阵列（CFA）采样频率的规则性图案干扰，导致输出图像带有莫尔条纹。为解决该问题，提出一种基于二阶Newton插值近似的数码图像莫尔条纹消除算法。利用小波变换提取G分量在水平和垂直方向的高频信息，通过对高频信息做频域变换模拟CFA混叠过程，进而对图像中莫尔区域及其潜在区域进行检测。针对莫尔条纹区域，利用二阶Newton插值获取G分量各方向的估计值，并对所得估计值加权平均取得丢失的G分量，再采用色差空间模型插值恢复R和B分量，最终得到消除莫尔条纹且包含完整RGB信息的图像。实验结果表明，该算法在不影响图像色彩质量的同时能有效去除莫尔条纹，且相比双线性插值、Hibbard等算法恢复图像的峰值信噪比更高、主观视觉效果更好。

关键词: 莫尔条纹, 小波变换, 频域变换, 二阶Newton插值, 色差空间, 峰值信噪比

CLC Number:

TP371

LIANG Meng, SHI Xiaoshuang. Moire Fringe Elimination Algorithm Based on Second-order Newton Interpolation[J]. Computer Engineering, 2020, 46(5): 259-266.

梁猛, 史晓霜. 基于二阶Newton插值的莫尔条纹消除算法[J]. 计算机工程, 2020, 46(5): 259-266.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0054708

http://www.ecice06.com/EN/Y2020/V46/I5/259

Figures/Tables 14

References

[1] DEEPTHI M J,ABRAHAM T.Combined denoising and demosaicing of CFA images[C]//Proceedings of IEEE International Conference on Signal Processing,Informatics,Communication and Energy Systems.Washington D.C.,USA:IEEE Press,2015:1-6.
[2] GUO Linghua,GUO Xinhua,XIE Yulin.Study of image analysis methods based on Moire Fringe[J].Packaging Engineering,2013(9):76-79.(in Chinese)郭凌华,郭新华,谢雨林.基于莫尔条纹的图像分析方法研究[J].包装工程,2013(9):76-79.
[3] DU Hongwei,ZHANG Yunfeng,BAO Fangxun.Rational function interpolation algorithm based on gradient optimization[J].Journal of Image and Graphics,2018,23(5):766-777.(in Chinese)杜宏伟,张云峰,包芳勋.梯度优化的有理函数图像插值[J].中国图象图形学报,2018,23(5):766-777.
[4] ZHONG Baojiang,LU Zhifang,JI Jiahuan.Review on image interpolation techniques[J].Journal of Data Acquisition and Processing,2016,31(6):1083-1096.(in Chinese)钟宝江,陆志芳,季家欢.图像插值技术综述[J].数字采集与处理,2016,31(6):1083-1096.
[5] QI Min,CHENG Gong,DU Qianmin,et al.New image interpolation method based on sub-regional and multi-directional data fusion[J].Journal of Data Acquisition and Processing,2016,31(1):73-84.(in Chinese)齐敏,程恭,杜乾敏,等.一种分区域多方向数据融合图像插值方法[J].数字采集与处理,2016,31(1):73-84.
[6] WANG L,JEON G.Bayer pattern CFA demosaicking based on multi-directional weighted interpolation and guided filter[J].Signal Processing Letters,2015,22(11):2083-2087.
[7] PEKKUCUKSEN I,ALTUNBASAK Y.Edge oriented directional color filter array interpolation[C]//Proceedings of International Conference on Acoustics,Speech and Signal Processing.Washington D.C.,USA:IEEE Press,2011:993-996.
[8] YU Jia.Research on Moire elimination algorithm for digital photos[D].Shanghai:Shanghai Jiao Tong University,2007.(in Chinese)余佳.数码相片莫尔条纹消除算法的研究[D].上海:上海交通大学,2007.
[9] ZHOU Hongyan.Research on Moire removal algorithm in digital images[D].Shanghai:Shanghai Jiao Tong University,2008.(in Chinese)周红艳.数码图像中莫尔条纹去除算法的研究[D].上海:上海交通大学,2008.
[10] PEKKUCUKSEN I,ALTUNBASAK Y.Multicale gradients-based color filter array interpolation[J].IEEE Transactions on Image Processing,2013,22(1):157-165.
[11] TIAN Qichuan,XUE Huijie,LIU Zihua,et al.An demosaicking algorithm based on deges[C]//Proceedings of International Conference on Image and Signal Processing.Washington D.C.,USA:IEEE Press,2015:246-250.
[12] MONNO Y,KIKU D,TANAKA M,et al.Adaptive residual interpolation for color image demosaicking[C]//Proceedings of International Conference on image Processing.Washington D.C.,USA:IEEE Press,2015:3861-3865.
[13] XU Shaoxiong,ZHANG Yu,CHEN Changzheng.Low complexity demosaicing algorithm for Bayer pattern image[J].Chinese Journal of Liquid Crystals and Displays,2016,31(2):179-184.(in Chinese)徐少熊,张宇,陈长征.低复杂度Bayer图像色彩重建算法[J].液晶与显示,2016,31(2):179-184.
[14] KIKU D,MONNO Y,TANAKA M,et al.Beyond color difference:residual interpolation for color image demosaicking[J].IEEE Transactions on Image Processing,2016,25(3):1288-1300.
[15] WANG Dongyan,YU Gang,ZHOU Xiao,et al.Image demosaicking for Bayer-patterned CFA images using improved linear interpolation[C]//Proceedings of the 17th International Conference on Information Science and Technology.Washington D.C.,USA:IEEE Press,2017:464-469.
[16] CHEN X D,HE L W,JEON G,et al.Multidirectional weighted interpolation and refinement method for Bayer pattern CFA demosaicking[J].IEEE Transactions on Circuits and Systems for Video Technology,2015,25(8):1271-1282.
[17] LI N,JIM S,LI J,et al.Color filter array demosaicking based on the distribution of directional color differences[J].IEEE Signal Processing Letters,2017,24(5):604-608.
[18] PARK D,JEONG J.Decision-based demosaicking algorithm using Bayesian theorem[C]//Proceedings of International Conference on Image Processing.Washington D.C.,USA:IEEE Press,2018:48136-48146.
[19] WU J J,ANISETTI M,WU W,et al.Bayer demosaicking with polynomial interpolation[J].IEEE Transactions on Image Processing,2016,25(11):5369-5382.
[20] LIEN C Y,YANG F J,CHEN P Y.An efficient edge-based technique for color filter array demosaicking[J].IEEE Sensors Journal,2017,17(13):4067-4068.
[21] YU Tingzhao,HU Wenrui,XUE Wei.Color image demosaicking via joint intra and inter channel information[J].Electronics Letters,2016,52(8):605-607.
[22] ZHAO Liang,ZHANG Yufeng,HUANG Changning.A low complexity interpolation algorithm for Bayer image based on color difference space[J].Spacecraft Recovery and Remote Sensing,2016,37(3):128-138.(in Chinese)赵亮,张宇烽,黄长宁.基于色差空间的低复杂度Bayer图像插值算法[J].航天返回与遥感,2016,37(3):128-138.
[23] YANG Wenju.Research on Nyquist undersampling and signal reconstruction algorithm[D].Beijing:Beijing Institute of Technology,2016.(in Chinese)杨文举.奈奎斯特欠采样和信号的重构算法研究[D].北京:北京理工大学,2016.
[24] PENG Yan.Research on color interpolation algorithm based on CCD image[D].Nanjing:Nanjing University of Science and Technology,2007.(in Chinese)彭晔.基于CCD图像的彩色插值算法研究[D].南京:南京理工大学,2007.
[25] ZHU Tonghua.Research on CFA image interpolation and desiccation[D].Xi'an:Xidian University,2012.(in Chinese)朱同华.CFA图像插值与去燥研究[D].西安:西安电子科技大学,2012.

Please choose a citation manager

Content to export