基于深度学习的牙齿嵌塞自动判别方法

doi:10.19678/j.issn.1000-3428.0061934

计算机工程 ›› 2022, Vol. 48 ›› Issue (4): 307-313. doi: 10.19678/j.issn.1000-3428.0061934

基于深度学习的牙齿嵌塞自动判别方法

王志江¹, 秦品乐¹, 柴锐¹, 武峰², 程一彤², 史玥²

1. 中北大学大数据学院山西省生物医学成像与影像大数据重点实验室, 太原 030051;
2. 山西医科大学口腔医院修复科, 太原 030012

收稿日期:2021-06-16 修回日期:2021-08-09 发布日期:2022-04-14
作者简介:王志江(1996—),男,硕士研究生,主研方向为三维点云、深度学习;秦品乐,教授;柴锐(通信作者),博士;武峰,教授;程一彤、史玥,硕士研究生。
基金资助:
山西省重点研发计划项目（201903D321120）；山西省高等学校科技创新项目（2019L0533）。

Automatic Identification Method of Tooth Impaction Based on Deep Learning

WANG Zhijiang¹, QIN Pinle¹, CHAI Rui¹, WU Feng², CHENG Yitong², SHI Yue²

1. Shanxi Provincial Key Laboratory of Biomedical Imaging and Imaging Big Data, College of Big Data, North University of China, Taiyuan 030051, China;
2. Department of Prosthodontics, Stomatological Hospital of Shanxi Medical University, Taiyuan 030012, China

Received:2021-06-16 Revised:2021-08-09 Published:2022-04-14

摘要/Abstract

摘要： 食物嵌塞是口腔常见病征，容易引发局部牙龈红肿、溢脓、龋齿等口腔问题，给患者带来极大的痛苦和不便。目前临床上难以自动筛查嵌塞牙齿，且传统的锥形束CT重建方法的准确度及精度均有待提高。提出一种牙齿嵌塞自动化判断的方法，对牙齿模型进行单个牙体的精准分割，在U-Net网络的基础上使用KPConv卷积核代替二维卷积核来构建分割网络，并使用图割方法优化分割结果。同时，采用平面拟合的方法将分割后的牙齿模型投影到水平和竖直平面上，在平面上求出牙齿嵌塞特征，并利用支持向量机根据所求特征对牙齿的嵌塞情况进行判断。通过充分利用样本模型的几何结构信息，设计简化牙齿模型的几何采样及包含牙齿几何结构约束的图割方法提高网络模型的运算时间及精度。实验结果表明，该方法对牙齿模型的分割准确率为92%，对牙齿嵌塞的判断正确率为81%，能够为医生提供辅助诊断。

关键词: 深度学习, 点云分割, 牙齿分割, 食物嵌塞, 支持向量机

Abstract: Food impaction is a common oral symptom, which easily causes oral problems, such as local gingival redness, pus overflow, and dental caries, bringing great pain and inconvenience to patients.At present, automatically screening impacted teeth in clinics is difficult, and the accuracy of the traditional cone beam CT reconstruction method must improve.An automatic judgment method of tooth impaction is proposed to accurately segment a single tooth in the tooth model.Based on the U-NET network, a KPConv convolution kernel was used, instead of a two-dimensional convolution kernel, to construct the segmentation network, and the graph cut method was used to optimize the segmentation results.Meanwhile, the segmentation model after the embedded teeth plug features according to the relevant judgment of whether to plug embedded teeth using the plane projection method from the horizontal to the vertical plane, the plane and the embedded teeth characteristics, and the support vector machine asking for the teeth embedded plug profile of judgment.The geometric sampling of the simplified tooth model and graph cutting method containing the constraints of the tooth geometric structure were designed by fully using the geometric structure information of the sample model, improving the operation time and accuracy of the network model.The results show that the segmentation accuracy of the tooth model can reach 92%, and the judgment accuracy of tooth impaction can reach 81%, which can provide doctors with auxiliary diagnoses.

Key words: deep learning, point cloud segmentation, tooth segmentation, food embedded plug, Support Vector Machine (SVM)

中图分类号:

TP391

王志江, 秦品乐, 柴锐, 武峰, 程一彤, 史玥. 基于深度学习的牙齿嵌塞自动判别方法[J]. 计算机工程, 2022, 48(4): 307-313.

WANG Zhijiang, QIN Pinle, CHAI Rui, WU Feng, CHENG Yitong, SHI Yue. Automatic Identification Method of Tooth Impaction Based on Deep Learning[J]. Computer Engineering, 2022, 48(4): 307-313.

https://www.ecice06.com/CN/Y2022/V48/I4/307

图/表 9

20230131202821

20230131202824

20230131202827

20230131202831

20230131202834

20230131202837

20230131202840

20230131202843

20230131202846

参考文献

[1] 马毅慧, 郭家平, 王虎中, 等.咬合主功能区调整对食物嵌塞治疗效果临床观察[J].临床口腔医学杂志, 2013, 29(11):683-685. MA Y H, GUO J P, WANG H Z, et al.Clinical studies of occlusal adjustment with main founctional zones for food impaction[J].Journal of Clinical Stomatology, 2013, 29(11):683-685.(in Chinese)
[2] 王月.量化调(牙合)治疗垂直型食物嵌塞临床相关参数的CBCT研究[D].太原:山西医科大学. WANG Y.CBCT study of clinical parameters related to quantitative adjustment (occlusion) in the treatment of vertical food impaction[D].Taiyuan:Shanxi Medical University.(in Chinese)
[3] KONDO T, ONG S H, FOONG K.Tooth segmentation of dental study models using range images[J].IEEE Transactions on Medical Imaging2004, 23(3):350-362.
[4] GRZEGORZEK M, TRIERSCHEID M, D PAPOUTSIS, et al.A multi-stage approach for 3D segmentation from dentition surfaces[C]//Processing of the 4th International Conference on Image and Signal.Berlin, Germany:Springer, 2010:521-530.
[5] WONGWAEN N, SINTHANAYOTHIN C.Computerized algorithm for 3D teeth segmentation[C]//Proceedings of International Conference on Electronics and Information Engineering.Washington D.C., USA:IEEE Press, IEEE Press, 2010:271-277.
[6] KUMAR Y, JANARDAN R, LARSON B, et al.Improved segmentation of teeth in dental models[J].Computer-Aided Design and Applications, 2011, 8(2):211-224.
[7] HARLES R Q, HAO S, MO K C, et al.PointNet:deep learning on point sets for 3D classification and segmentation[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2017:77-85.
[8] XU X J, LIU C, ZHENG Y Y.3D tooth segmentation and labeling using deep convolutional neural networks[J].IEEE Transactions on Visualization and Computer Graphics, 2019, 25(7):2336-2348.
[9] TIAN S K, DAI N, ZHANG B, et al.Automatic classification and segmentation of teeth on 3D dental model using hierarchical deep learning networks[J].IEEE Access, 2019, 7:84817-84828.
[10] LIAN C F, WANG L, WU T H, et al.Deep multi-scale mesh feature learning for automated labeling of raw dental surfaces from 3D intraoral scanners[J].IEEE Transactions on Medical Imaging, 2020, 39(7):2440-2450.
[11] SUN D Y, PEI Y R, SONG G Y, et al.Tooth segmentation and labeling from digital dental casts[C]//Proceedings of the 17th International Symposium on Biomedical Imaging.Washington D.C., USA:IEEE Press, 2020:669-673.
[12] CHEN Y L, DU H Y, YUN Z Q, et al.Automatic segmentation of individual tooth in dental CBCT images from tooth surface map by a multi-task FCN[J].IEEE Access, 2020, 8:97296-97309.
[13] ROYNARD X, DESCHAUD J E, GOULETTE F.Classification of point cloud scenes with multiscale voxel deep network[EB/OL].[2021-05-16].https://arxiv.org/abs/1804.03583.
[14] BEN-SHABAT Y, LINDENBAUM M, FISCHER A.3DmFV:three-dimensional point cloud classification in real-time using convolutional neural networks[J].IEEE Robotics and Automation Letters, 2018, 3(4):3145-3152.
[15] ZHAO H S, JIANG L, FU C W, et al.PointWeb:enhancing local neighborhood features for point cloud processing[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2019:5560-5568.
[16] WANG L, HUANG Y, HOU Y, et al.Graph attention convolution for point cloud semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2019:10296-10305.
[17] XIE S N, LIU S N, CHEN Z Y, et al.Attentional ShapeContextNet for point cloud recognition[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:4606-4615.
[18] MAO J G, WANG X G, LI H S.Interpolated convolutional networks for 3D point cloud understanding[C]//Proceedings of IEEE/CVF International Conference on Computer Vision Washington D.C., USA:IEEE Press, 2019:1578-1587.
[19] THOMAS H, QI C R, DESCHAUD J E, et al.KPConv:flexible and deformable convolution for point clouds[C]//Proceedings of IEEE/CVF International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2019:6410-6419.
[20] WU Z W, LI G, WANG L, et al.Registration-free infant cortical surface parcellation using deep convolutional neural networks[C]//Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention.Berlin, Germany:Springer, 2018:672-680.
[21] BOYKOV Y, VEKSLER O, ZABIH R.Fast approximate energy minimization via graph cuts[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(11):1222-1239.
[22] LIAN C F, WANG L, WU T H, et al.Deep multi-scale mesh feature learning for automated labeling of raw dental surfaces from 3D intraoral scanners[J].IEEE Transactions on Medical Imaging, 2020, 39(7):2440-2450.
[23] JOACHIMS T.Aking large-scale SVM learning practical[EB/OL].[2021-05-16].https://ideas.repec.org/p/zbw/sfb475/199828.html.

选择文件类型/文献管理软件名称

选择包含的内容

基于深度学习的牙齿嵌塞自动判别方法

Automatic Identification Method of Tooth Impaction Based on Deep Learning

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	陈增照, 王政, 郑秋雨. 基于全范围头部姿态估计的教师注意力识别算法[J]. 计算机工程, 2024, 50(7): 96-103.
[2]	牛瑞婷, 严天峰, 高锐, 王映植. 低信噪比下基于深度学习TCNN-MobileNet的调制识别[J]. 计算机工程, 2024, 50(7): 204-215.
[3]	肖慈, 徐杨, 张永丹, 冯明文, 黄易仟. 结合注意力和低光增强的夜间语义分割[J]. 计算机工程, 2024, 50(7): 271-281.
[4]	张诗婧, 莫绪涛, 赵行, 董杨林. 基于球面折反射成像和YOLOv7的内螺纹缺陷检测[J]. 计算机工程, 2024, 50(7): 282-292.
[5]	徐明亮, 李芳媛, 马浩然, 何飞. 大规模神经记录的峰电位聚类算法(特邀)[J]. 计算机工程, 2024, 50(6): 1-34.
[6]	魏琢艺, 罗迈, 李文兵, 曾远松, 余伟江, 杨跃东. 基于多源域适应的单细胞智能分类[J]. 计算机工程, 2024, 50(6): 48-55.
[7]	李子杰, 周菊香, 韩晓瑜, 甘健侯, 鹿泽光, 王俊. 序列特征与学习过程融合的知识追踪模型[J]. 计算机工程, 2024, 50(6): 77-85.
[8]	李永飞, 李铭洋, 常鑫, 曹可欣. 基于可解释性深度学习的物联网水质监测数据异常检测[J]. 计算机工程, 2024, 50(6): 179-187.
[9]	李致金, 汤佳辉, 闫金凤. 基于边缘计算的轻量化识别方法[J]. 计算机工程, 2024, 50(6): 287-295.
[10]	李雪, 王雅文, 张前进. 基于信息检索的源代码自动命名[J]. 计算机工程, 2024, 50(6): 304-310.
[11]	孙帮勇, 马铭, 于涛. 基于区域特征强化的多尺度伪装目标检测方法[J]. 计算机工程, 2024, 50(5): 209-219.
[12]	周秦源, 邓越平, 张磊, 张陈, 卢日荣, 胡贤哲. 融合光流与多视角几何的动态视觉SLAM系统[J]. 计算机工程, 2024, 50(5): 250-259.
[13]	郑娟毅, 张庆珏, 董嘉豪, 郭梦月, 杨溥江. 一种深度学习的波束空间信道估计算法[J]. 计算机工程, 2024, 50(5): 298-305.
[14]	赵逸飞, 张俊华. 虚拟脊柱侧凸病例腰椎自动生成方法[J]. 计算机工程, 2024, 50(5): 323-329.
[15]	刘仲民, 严梁. 融合动态特征与注意力的敦煌壁画修复模型[J]. 计算机工程, 2024, 50(5): 342-353.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于深度学习的牙齿嵌塞自动判别方法

Automatic Identification Method of Tooth Impaction Based on Deep Learning

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 9

参考文献

相关文章 15

编辑推荐

Metrics

本文评价