作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程

所属专题: 虚拟现实专题

• 虚拟现实专题 • 上一篇    下一篇

基于深度图像分割的虚拟视点绘制

娄达平,王晓东,富显祖,章联军   

  1. (宁波大学 信息科学与工程学院,浙江 宁波 315000)
  • 收稿日期:2015-12-21 出版日期:2016-10-15 发布日期:2016-10-15
  • 作者简介:娄达平(1991—),男,硕士研究生,主研方向为虚拟现实、多媒体信号处理;王晓东,副教授;富显祖,硕士研究生;章联军,工程师、硕士。
  • 基金资助:
    国家自然科学基金资助重点项目(U1301257);国家科技支撑计划基金资助项目(2012BAH67F01);浙江省教育厅科研计划基金资助项目(Y201327703);浙江省科技厅创新团队自主设计基金资助项目(2012R10009-08);宁波市科技创新团队研究计划基金资助项目(2011B81002)。

Virtual View Point Rendering Based on Range Image Segmentation

LOU Daping,WANG Xiaodong,FU Xianzu,ZHANG Lianjun   

  1. (School of Information Science and Engineering,Ningbo University,Ningbo,Zhejiang 315000,China)
  • Received:2015-12-21 Online:2016-10-15 Published:2016-10-15

摘要: 针对虚拟视点绘制中出现的伪轮廓和空洞问题,提出一种改进的虚拟视点绘制算法。根据深度信息标记出深度图像的不可信区域,通过多阈值图像分割技术对图像进行分割处理,利用三维图像变换生成虚拟视点图像,并采用局部中值滤波消除目标图像中存在的细小空洞。对绘制出的两幅图像进行融合处理,并应用图像修复法填充剩余的空洞。实验结果表明,该算法能获得的虚拟视点图像质量较高,同时与MPEG提供的虚拟视点绘制标准参考软件相比,生成的虚拟视点PSNR值提高了0.74 dB。

关键词: 虚拟视点, 深度图像, 图像分割, 三维图像变换, 局部中值滤波, 图像修复

Abstract: This paper proposes an improved virtual view point rendering algorithm to solve the problems of ghosting and holes in the virtual view point rendering.This method marks the unreliable regions of depth map based on the depth information.Through multi-threshold image segmentation,the image is divided into different parts.A virtual view point is generated by making use of 3D image warping.In order to deal with the small cracks,local median filtering is used to obtain a single-view point image.Two generated virtual images are blended together to eliminate the disocclused holes in the desired view.An inpainting method is utilized to eliminate the remaining holes.Experimental results show that high quality virtual view points are generated,the Peak Signal to Noise Ratio(PSNR) of virtual view point can be 0.74 dB higher than that standard reference software of virtual view point rendering.

Key words: virtual view point, range image, image segmentation, 3D image transformation, local median filtering, image inpainting

中图分类号: