立体图像质量感知特征提取的研究与展望

doi:10.19678/j.issn.1000-3428.0046943

摘要/Abstract

摘要： 图像质量感知特征提取和图像质量值映射是立体图像质量评价(SIQA)算法的核心组成模块。相对于2D图像质量评价算法,SIQA算法所提取的图像质量感知特征中需要引入视差、立体观察舒适度和立体显著度等影响立体质量感觉的各种因素,而在图像质量值映射方面则区别不大。为此,以考虑视差信息为主要划分标准,分类综述SIQA算法提取立体图像质量感知特征的各种方法,并相应评析它们的特点,对提取立体图像质量感知特征当前存在的问题和未来的研究方向进行分析和展望。

关键词: 立体图像质量评价, 质量感知特征提取, 视差信息, 自动化提取, 人类视觉系统

Abstract: The image quality-aware perception feature extraction and image quality value mapping are the core components of the Stereoscopic Image Quality Assessment(SIQA) algorithm.Related to 2D Image Quality Assessment(2D-IQA) algorithm,various factors affecting stereoscopic quality perception such as parallax,stereoscopic viewing comfort and stereo saliency need to be introduced in the image quality-aware feature extracted by SIQA algorithm,but there is little difference in image quality value mapping.Therefore,considering the parallax information as the main classification standard,the SIQA algorithm is used to extract various methods which the quality-aware features of stereoscopic images are introduced,and their characteristics are reviewed.The current problems and future research directions for extracting stereoscopic image quality-aware features are analyzed and forecasted.

Key words: Stereoscopic Image Quality Assessment(SIQA), quality-aware feature extraction, parallax information, automatization extraction, Human Visual System(HVS)

中图分类号:

TP391

徐少平,林官喜,曾小霞,姜尹楠,唐祎玲. 立体图像质量感知特征提取的研究与展望[J]. 计算机工程, 2018, 44(6): 239-248.

XU Shaoping,LIN Guanxi,ZENG Xiaoxia,JIANG Yinnan,TANG Yiling. Research and Prospect of Stereoscopic Image Quality-aware Feature Extraction[J]. Computer Engineering, 2018, 44(6): 239-248.

https://www.ecice06.com/CN/Y2018/V44/I6/239

参考文献

［1］王志明.无参考图像质量评价综述［J］.自动化学报,2015,41(6):1062-1079.
［2］马允,王晓东,富显祖,等.基于 GA-SVR模型的无参考立体图像质量评价［J］.计算机工程,2017,43(5):234-239,247.
［3］蒋刚毅,黄大江,王旭,等.图像质量评价方法研究进展［J］.电子与信息学报,2010,32(1):219-226.
［4］XU Shaoping,JIANG Shunliang,MIN Weidong.No-reference/blind image quality assessment:a survey［J］.IETE Technical Review,2017,34(3):223-245.
［5］CHEN M J,SU C C,KWON D K,et al.Full-reference quality assessment of stereopairs accounting for rivalry［J］.Signal Processing:Image Communication,2013,28(9):1143-1155.
［6］LIN Weisi,KUO J C C.Perceptual visual quality metrics:a survey［J］.Journal of Visual Communication and Image Representation,2011,22(4):297-312.
［7］WANG Z,BOVIK A C.Reduced and no-reference image quality assessment［J］.IEEE Signal Processing Magazine,2011,28(6):29-40.
［8］KAMBLE V,BHURCHANDI K M.No-reference image quality assessment algorithms:a survey［J］.Optik-international Journal for Light and Electron Optics,2015,126(11-12):1090-1097.
［9］CHEN M J,CORMACK L K,BOVIK A C.No-reference quality assessment of natural stereopairs［J］.IEEE Transactions on Image Processing,2013,22(9):3379-3391.
［10］MOORTHY A K,SU C C,MITTAL A,et al.Subjective evaluation of stereoscopic image quality［J］.Signal Processing:Image Communication,2013,28(8):870-883.
［11］KIM T,KANG T,LEE S,et al.Multimodal interactive continuous scoring of subjective 3D video quality of experience［J］.IEEE Transactions on Multimedia,2014,16(2):387-402.
［12］LEE K,MOORTHY A K,LEE S,et al.3D visual activity assessment based on natural scene statistics［J］.IEEE Transactions on Image Processing,2014,23(1):450-465.
［13］KIM H,LEE S,BOVIK A C.Saliency prediction on stereoscopic videos［J］.IEEE Transactions on Image Processing,2014,23(4):1476-1490.
［14］SU C C,CORMACK L K,BOVIK A C.Color and depth priors in natural images［J］.IEEE Transactions on Image Processing,2013,22(6):2259-2274.
［15］王珊珊,邵枫,蒋刚毅,等.基于双目能量响应的无参考立体图像质量评价［J］.光电子·激光,2014,25(4):741-747.
［16］姜求平,邵枫,蒋刚毅,等.基于视差空间图的立体图像质量客观评价方法［J］.光电子·激光,2013,24(12):2049-2015.
［17］张艳,安平,张秋闻,等.视觉关注度的立体图像质量评价［J］.中国图象图形学报,2012,17(6):722-725.
［18］CAMPISI P,CALLET P L,MARINI E.Stereoscopic images quality assessment［C］//Proceedings of the 15th Conference on Signal Processing.Washington D.C.,USA:IEEE Press,2007:2110-2114.
［19］GORLEY P,HOLLIMAN N.Stereoscopic image quality metrics and compression［C］//Proceedings of the 19th Conference on Stereoscopic Displays and Applications.San Jose,USA:SPIE Press,2008:680-685.
［20］RYU S,KIM D H,SOHN K.Stereoscopic image quality metric based on binocular perception model［C］//Proceedings of IEEE International Conference on Image Processing.Washington D.C.,USA:IEEE Press,2012:609-612.
［21］WANG Jiheng,WANG Zhou.Perceptual quality of asymmetrically distorted stereoscopic images:the role of image distortion types［C］//Proceedings of International Workshop on Video Processing and Quality Metrics for Consumer Electronics.Washington D.C.,USA:IEEE Press,2014:29-31.
［22］BENOIT A,CALLET P L,CAMPISI P,et al.Quality assessment of stereoscopic images［J］.EURASIP Journal on Image and Video Processing,2008(1):1-13.
［23］YOU J,XING Liyuan,PERKIS A,et al.Perceptual quality assessment for stereoscopic images based on 2D image quality metrics and disparity analysis［C］//Proceedings of the 5th International Workshop on Video Processing and Quality Metrics for Consumer Electronics.Washington D.C.,USA:IEEE Press,2010:1-6.
［24］毛香英,郁梅,蒋刚毅,等.基于结构失真分析的立体图像质量客观评价模型［J］.计算机辅助设计与图形学学报,2012,24(8):1047-1056.
［25］CARDOSO M J V,REGIS C D M,ALENCAR M S.Disparity weighting applied to full-reference and no reference stereoscopic image quality assessment［C］//Proceedings of IEEE International Conference on Consumer Electronics.Washington D.C.,USA:IEEE Press,2015:477-480.
［26］SHEN Lili,YANG Jiachen,ZHANG Zhuoyun.Quality assessment of stereo images with stereo vision［C］//Proceedings of International Conference on Image and Signal Processing.Washington D.C.,USA:IEEE Press,2009:503-508.
［27］CHETOUANI A.Full reference image quality metric for stereo images based on cyclopean image computation and neural fusion［C］//Proceedings of IEEE Visual Communications and Image Processing Conference.Washington D.C.,USA:IEEE Press,2014:109-112.
［28］MOORTHY A K,BOVIK A C.Blind image quality assessment:from natural scene statistics to perceptual quality［J］.IEEE Transactions on Image Processing,2011,20(12):3350-3364.
［29］SHAO Feng,TIAN Weijun,LIN Weisi,et al.Toward a blind deep quality evaluator for stereoscopic images based on monocular and binocular interactions［J］.IEEE Transactions on Image Processing,2016,25(5):2059-2074.
［30］ZHANG Yi,CHANDLER D M.3D-MAD:a full reference stereoscopic image quality estimator based on binocular lightness and contrast perception［J］.IEEE Transactions on Image Processing,2015,24(11):3810-3825.
［31］JIANG Gangyi,ZHOU Junming,YU Mei,et al.Binocular vision based objective quality assessment method for stereoscopic images［J］.Multimedia Tools and Applications,2015,74(18):8197-8218.
［32］BENSALMA R,LARABI M C.A perceptual metric for stereoscopic image quality assessment based on the binocular energy［J］.Multidimensional Systems and Signal Processing,2013,24(2):281-316.
［33］SHAO Feng,LIN Weisi,GU Shanbo,et al.Perceptual full-reference quality assessment of stereoscopic images by considering binocular visual characteristics［J］.IEEE Transactions on Image Processing,2013,22(5):1940-1953.
［34］SHAO Feng,LI Kemeng,LIN Weisi,et al.Full-reference quality assessment of stereoscopic images by learning binocular receptive field properties［J］.IEEE Transactions on Image Processing,2015,24(10):2971-2983.
［35］SHAO Feng,LIN Weisi,WANG Shanshan,et al.Blind image quality assessment for stereoscopic images using binocular guided quality lookup and visual codebook［J］.IEEE Transactions on Broadcasting,2015,61(2):154-165.
［36］ZHOU Wujie,LU Yu.No-reference stereoscopic image quality measurement based on generalized local ternary patterns of binocular energy response［J］.Measurement Science and Technology,2015,26(9).
［37］MD K S,APPINA B,CHANNAPPAYYA S S.Full-reference stereo image quality assessment using natural stereo scene statistics［J］.IEEE Signal Processing Letters,2015,22(11):1985-1989.
［38］SU C C,BOVIK A C,CORMACK L K.Natural scene statistics of color and range［C］//Proceedings of the 18th IEEE International Conference on Image Processing.Washington D.C.,USA:IEEE Press,2011:257-260.
［39］SU C C,CORMACK L K,BOVIK A C.Oriented correlation models of distorted natural images with application to natural stereopair quality evaluation［J］.IEEE Transactions on Image Processing,2015,24(5):1685-1699.
［40］APPINA B,KHAN S,CHANNAPPAYYA S S.No-reference stereoscopic image quality assessment using natural scene statistics［J］.Signal Processing:Image Communication,2016,43:1-14.
［41］LEE K,LEE S.3D perception based quality pooling:Stereopsis,binocular rivalry,and binocular suppression［J］.IEEE Journal of Selected Topics in Signal Processing,2015,9(3):533-545.
［42］JUNG Y J,KIM H G,RO Y M.Critical binocular asymmetry measure for perceptual quality assessment of synthesized stereo 3D images in view synthesis［J］.IEEE Transactions on Circuits and Systems for Video Technology,2015,26(7):1201- 1214.
［43］LIN Y H,WU J L.Quality assessment of stereoscopic 3D image compression by binocular integration behaviors［J］.IEEE Transactions on Image Processing,2014,23(4):1527-1542.
［44］宋洋,郁梅,彭宗举,等.基于双目信息融合的立体图像质量评价模型［J］.光电子技术,2014,34(2):102-105.
［45］WANG J,REHMAN A,ZENG K,et al.Quality prediction of asymmetrically distorted stereoscopic 3D images［J］.IEEE Transactions on Image Processing,2015,24(11):3400-3414.
［46］YANG Jiachen,LIU Yun,GAO Zhiqun,et al.A perceptual stereoscopic image quality assessment model accounting for binocular combination behavior［J］.Journal of Visual Communication Image Representation,2015,31:138-145. ［47］顾珊波,邵枫,蒋刚毅,等.基于支持向量回归的立体图像客观质量评价模型［J］.电子与信息学报,2012,34(2):369-374.
［48］KIM H,LEE S.Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort［J］.IEEE Transactions on Multimedia,2015,17(12):2198-2209.
［49］SHAO Feng,LIN Weisi,JIANG Gangyi,et al.Models of monocular and binocular visual perception in quality assessment of stereoscopic images［J］.IEEE Tran-sactions on Computational Imaging,2016,2(2):123-135.
［50］桑庆兵,谭红宝.极端学习四元数小波特征的立体图像质量评价［J］.光电子·激光,2016,27(6):662-669.
［51］SAHA A,WU Q M J.Utilizing image scales towards totally training free blind image quality assessment［J］.IEEE Transactions on Image Processing,2015,24(6):1879-1892.
［52］田维军,邵枫,蒋刚毅,等.基于深度学习的无参考立体图像质量评价［J］.计算机辅助设计与图形学学报,2016,28(6):968-975.

[1]	王宽, 杨环, 潘振宽, 司建伟. 基于单目和双目视觉信息的全参考立体图像质量评价模型[J]. 计算机工程, 2022, 48(2): 207-214,223.
[2]	楼鑫杰, 李小薪, 刘志勇. 基于反馈机制的图像超分辨率重建算法[J]. 计算机工程, 2022, 48(2): 261-267.
[3]	史玉华, 张闯, 迟兆鑫. 基于多元特征的立体图像质量评价方法[J]. 计算机工程, 2021, 47(12): 256-265.
[4]	吴强,刘华凯,稂时楠. 基于HVS的空中红外小目标快速检测算法[J]. 计算机工程, 2019, 45(5): 210-215,221.
[5]	马允,王晓东,富显祖,娄达平,章联军. 基于GA-SVR模型的无参考立体图像质量评价[J]. 计算机工程, 2017, 43(5): 234-239,247.
[6]	王威,刘婧,杨蔚蔚,李骥. 基于DCT域纹理结构相似度的模糊图像质量评价[J]. 计算机工程, 2015, 41(11): 253-256.
[7]	肖振久，田淑娇，陈虹. 基于图像纹理复杂度的小波域数字水印算法[J]. 计算机工程, 2014, 40(6): 85-88.
[8]	金涛,何加铭,杨任尔,曾兴斌,樊玲慧. 基于视觉感知与菱形编码的图像隐写算法[J]. 计算机工程, 2014, 40(10): 6-10.
[9]	刘致远，陈耀武. 基于主观质量的JPEG XR量化参数选择[J]. 计算机工程, 2014, 40(1): 239-245.
[10]	马苗, 曾晴, 邵利平. 不可见水印的透明性评价[J]. 计算机工程, 2013, 39(6): 38-42,55.
[11]	陈晓雷, 张爱华, 陈莉莉, 林冬梅, 杨欣翥. 多优先级感兴趣区H.264计算资源分配[J]. 计算机工程, 2013, 39(4): 283-286.
[12]	张涛，梁德群，王新年，刘丽娟. 基于三维结构张量的图像模糊度评价方法[J]. 计算机工程, 2013, 39(11): 230-234.
[13]	马丽红, 龚紫平. 频率与方向敏感SSIM的图像质量评价方法[J]. 计算机工程, 2012, 38(5): 19-24.
[14]	苏品刚, 尚丽, 陈杰, 颜廷秦. 一种新的毫米波图像去噪方法?[J]. 计算机工程, 2012, 38(21): 229-231,244.
[15]	吴雪垠, 吴谨, 刘劲, 吴建国. 小波系数统计特征量密写分析方法[J]. 计算机工程, 2012, 38(21): 138-140,144.

选择文件类型/文献管理软件名称

选择包含的内容