Author Login Editor-in-Chief Peer Review Editor Work Office Work

Computer Engineering ›› 2021, Vol. 47 ›› Issue (10): 1-15. doi: 10.19678/j.issn.1000-3428.0061710

• Research Hotspots and Reviews • Previous Articles     Next Articles

Overview of 3D Human Lumen Reconstruction Technology Based on Computer Vision

WU Haibin1, XU Ruotong1, WANG Aili1, YU Xiaoyang1, IWAHORI Yuji2, ZHAO Lanfei1, LIU He1   

  1. 1. Heilongjiang Province Key Laboratory of Laser Spectroscopy Technology and Application, Harbin University of Science and Technology, Harbin 150080, China;
    2. Department of Computer Science, Chubu University, Aichi 487-8501, Japan
  • Received:2021-05-20 Revised:2021-07-02 Published:2021-07-02

基于计算机视觉的人体内腔三维重建技术综述

吴海滨1, 徐若彤1, 王爱丽1, 于晓洋1, 岩堀祐之2, 赵蓝飞1, 刘赫1   

  1. 1. 哈尔滨理工大学 黑龙江省激光光谱技术及应用重点实验室, 哈尔滨 150080;
    2. 中部大学计算机科学学院, 日本 爱知 487-8501
  • 作者简介:吴海滨(1977-),男,教授、博士生导师,主研方向为机器视觉;徐若彤,硕士研究生;王爱丽(通信作者),副教授、博士;于晓洋、岩堀祐之,教授、博士生导师;赵蓝飞,讲师、博士;刘赫,副教授、博士。
  • 基金资助:
    国家自然科学基金(61671190,61801149);日本学术振兴会科学基金(20K11873);黑龙江省普通高校专项基金(LGYC2018JC050)。

Abstract: The human lumen images observed by the doctor through the endoscope is shown in a two-dimensional style, and fail to present the three-dimensional relationships between the lesions, blood vessels and adjacent tissues in the human lumen.The three-dimensional human lumen reconstruction technology and visualization methods can clearly and comprehensively display the three-dimensional images of lesions and tissues, assisting doctors in precise operations.In this paper, the three-dimensional reconstruction technologies for human lumen are divided into the active measurement methods and passive measurement methods.On this basis, this paper summarizes the reconstruction technologies based on structured light, Time Of Flight(TOF), binocular stereo vision, and monocular vision in order, and discusses their development.Then focusing on the reconstruction technology using Simultaneous Localization and Mapping(SLAM), the paper analyzes and compares the development, methods and characteristics of the feature point detection and matching in human lumen.Finally, the difficulties and future development trends of the three-dimensional human lumen reconstruction technology are prospected.

Key words: 3D lumen reconstruction, structured light, Time Of Flight(TOF), binocular stereo vision, monocular vision, feature point detection, feature point matching

摘要: 医生通过内窥镜观察的人体内腔显示为二维图像,不能立体地展现内腔环境中病灶、血管及邻近组织的关系,而内腔三维重建及可视化技术能够清晰、全面地展现病灶及其他组织的三维形态,更好地辅助医生进行精准的手术判断。将人体内腔环境中的三维重建技术分为主动式测量方法与被动式测量方法,分类综述基于结构光、飞行时间、双目立体视觉、单目视觉的内腔三维重建技术及发展现状。针对同时定位与地图构建的内腔三维重建法,分析对比内腔环境下的特征点检测与匹配的发展、方法及特点,并对人体内腔三维重建的难点和未来发展趋势进行展望。

关键词: 内腔三维重建, 结构光, 飞行时间, 双目立体视觉, 单目视觉, 特征点检测, 特征点匹配

CLC Number: