作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2023, Vol. 49 ›› Issue (7): 204-213. doi: 10.19678/j.issn.1000-3428.0065323

• 图形图像处理 • 上一篇    下一篇

面向低质量裂缝图像的多知识蒸馏分类

曹坪1, 杨怀志2, 薄一军2, 尤嘉3, 张淳杰1,*, 李丹勇4   

  1. 1. 北京交通大学 现代信息科学与网络技术北京市重点实验室, 北京 100044
    2. 京沪高速铁路股份有限公司, 北京 100038
    3. 中国铁道科学研究院集团有限公司电子计算技术研究所, 北京 100081
    4. 北京交通大学 电子信息工程学院, 北京 100044
  • 收稿日期:2022-07-22 出版日期:2023-07-15 发布日期:2022-10-11
  • 通讯作者: 张淳杰
  • 作者简介:

    曹坪(1995—),女,博士研究生,主研方向为计算机视觉

    杨怀志,正高级工程师

    薄一军,工程师

    尤嘉,高级工程师、博士

    李丹勇,副教授、博士

  • 基金资助:
    国家自然科学基金面上项目(62072026); 北京市自然科学基金(JQ20022); 京沪高速铁路股份有限公司科技研究项目-重大课题(京沪科研-2020-16)

Low-quality Crack Image Classification with Multi-Knowledge Distillation

Ping CAO1, Huaizhi YANG2, Yijun BO2, Jia YOU3, Chunjie ZHANG1,*, Danyong LI4   

  1. 1. Beijing Key Laboratory of Modern Information Science and Network Technology, Beijing Jiaotong University, Beijing 100044, China
    2. Beijing-Shanghai High Speed Railway Co., Ltd., Beijing 100038, China
    3. Electronic Computing Technology Research Institute of China Academy of Railway Sciences Group Co., Ltd., Beijing 100081, China
    4. School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing 100044, China
  • Received:2022-07-22 Online:2023-07-15 Published:2022-10-11
  • Contact: Chunjie ZHANG

摘要:

裂缝受损程度分类是混凝土安全检测中重要的环节之一,在真实场景下,由于裂缝图像分辨率的降低和模糊噪声的增多,导致现有的分类方法难以识别低质量裂缝图像的受损程度。提出一种面向低质量裂缝图像的多知识蒸馏分类方法,基于退化重建网络的教师模型通过模拟高分辨率裂缝图像的退化和重建过程,缓解与学生模型之间的域差异,利用高质量模型引导的学生模型从具有高分辨率信息的教师模型中学习类别知识和重建知识。通过将教师模型的类别知识迁移到学生模型中,使教师模型的重建网络监督学生模型生成更有利于分类的超分辨率图像,确保图像恢复和图像分类之间的动态交互。经过教师模型的重建知识和类别知识的多重知识引导,使缺乏高分辨率信息的学生模型能有效识别低质量裂缝图像的受损程度。实验结果表明,与单一知识蒸馏的方法相比,该方法在最低分辨率的情况下,在裂缝数据集上的分类准确率提高了4.02个百分点,能有效提高低质量裂缝图像受损程度的分类准确率。

关键词: 低质量图像, 知识蒸馏, 裂缝图像分类, 卷积神经网络, 图像重建

Abstract:

Classification of crack damage degree is a very important step in concrete safety detection. In real scenes, it is difficult for existing classification methods to classify low-quality crack images due to the reduction of resolution and increase of blurred noise in low-resolution crack images. Therefore, a low-quality crack image classification method guided by Multi-Knowledge Distillation(MKD) is proposed. The teacher model, which is based on the degenerate reconstruction network, alleviates the domain difference with the student model by simulating the degradation and reconstruction process of high-resolution crack images. The student model, which is guided by a high-quality model, learns classification and reconstruction knowledge from the teacher model with high-resolution information. This method not only transfers the classification knowledge of the teacher model to the student model but also supervises the student model through the reconstruction network of the teacher model. In this way, the student model is guided to generate super-resolution images that are more conducive to classification, ensuring a dynamic interaction between image restoration and image classification. Through the multiple knowledge guidance of reconstruction and category knowledge of the teacher model, the student model, which lacks high-resolution information, can also effectively identify the damage degree of low-quality crack images. The experimental results show that compared with the Single Knowledge Distillation (SKD) method, this method improves the classification accuracy on the crack dataset by 4.02 percentage points at the lowest resolution and can effectively improve the classification accuracy of the damage degree of low-quality crack images.

Key words: low-quality image, knowledge distillation, crack image classification, convolutional neural network, image reconstruction