基于位置信息和注意力机制的路面裂缝检测

doi:10.19678/j.issn.1000-3428.0067758

计算机工程 ›› 2024, Vol. 50 ›› Issue (4): 303-312. doi: 10.19678/j.issn.1000-3428.0067758

基于位置信息和注意力机制的路面裂缝检测

王安政^1,2, 党建武^1,2, 岳彪^1,2, 杨景玉¹

1. 兰州交通大学电子与信息工程学院, 甘肃兰州 730070;
2. 轨道交通信息与控制国家级虚拟仿真实验教学中心, 甘肃兰州 730070

收稿日期:2023-06-01 修回日期:2023-07-03 发布日期:2023-08-14
通讯作者: 党建武,E-mail:dangjw@mail.lzjtu.cn E-mail:dangjw@mail.lzjtu.cn
基金资助:
中央引导地方科技发展资金项目(22ZY1QA002);甘肃省教育科技创新项目(2021jyjbgs-05);甘肃省军民融合专项(2020JG01);甘肃省重点研发计划项目(21YF5GA158);甘肃省知识产权计划项目(21ZSCQ013)。

Road Crack Detection Based on Position Information and Attention Mechanism

WANG Anzheng^1,2, DANG Jianwu^1,2, YUE Biao^1,2, YANG Jingyu¹

1. School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, Gansu, China;
2. National Virtual Simulation Experimental Teaching Center for Railway Transportation Information and Control, Lanzhou 730070, Gansu, China

Received:2023-06-01 Revised:2023-07-03 Published:2023-08-14

摘要/Abstract

摘要： 路面裂缝是造成公路安全问题的主要因素。传统的裂缝检测通常以人工检测为主,存在效率低、不安全等问题,此外现有深度学习检测模型在面临阴影遮挡、背景复杂等干扰因素时会造成裂缝检测不完整。针对上述问题,提出一种基于位置信息和注意力机制的路面裂缝检测模型(PA-TransUNet)。[JP+1]首先,通过混合编码器接收输入图像,提取裂缝特征信息,引入查询项、键、值的位置信息,提升编码器Transformer中自注意力机制捕获裂缝形状和补偿特征信息丢失的能力。然后,输入裂缝特征到解码器进行上采样,设计一种基于注意力门控的解码模块(AGDM),AGDM通过抑制非裂缝区域来加强对裂缝区域的学习,提高裂缝检测的准确性和完整性。实验结果表明,PA-TransUNet模型在路面裂缝检测数据集(CFD)和Cracktree200这2个公开数据集上的F1值分别达到87.44%和82.58%。此外,为了进一步检验PA-TransUNet模型在实际工程中的裂缝检测能力,又在自制无人机裂缝(UAV Cracks)数据集上取得了88.68%的F1值,由此可见其能较好地满足实际工程中的裂缝检测需求。

关键词: 图像处理, 路面裂缝检测, 语义分割, 位置信息, 注意力机制

Abstract: Road cracks are the main cause of highway safety problems. Traditional crack detection is typically based on manual detection, which faces problems such as low efficiency and insecurity. In addition, the existing deep learning detection model causes incomplete crack detection when facing interference factors, such as shadow occlusion and complex backgrounds. To address these problems, a road crack detection model based on location information and an attention mechanism, known as PA-TransUNet, is proposed. First, the hybrid encoder receives the input image, extracts the crack feature information, and introduces the position information of the query, key, and value to improve the ability of the self-attention mechanism in the encoder Transformer to capture the crack shape and compensate for the loss of feature information. Subsequently, the crack features are input into the decoder for upsampling, and an Attention Gating-based Decoding Module(AGDM) is designed to strengthen the learning of crack regions by suppressing non-crack regions and improving the accuracy and integrity of crack detection. The experimental results demonstrate that the F1 values of the PA-TransUNet model on the CrackForest Dataset(CFD) and Cracktree200 public datasets reach 87.44% and 82.58%, respectively. In addition, to further test the crack detection ability of the PA-TransUNet model in practical engineering, an F1 value of 88.68% is achieved on the self-made Unmanned Aerial Vehicle Cracks(UAV Cracks) dataset, which shows that it can better meet the needs of crack detection in practical engineering.

Key words: image processing, road crack detection, semantic segmentation, position information, attention mechanism

中图分类号:

TP391.9

王安政, 党建武, 岳彪, 杨景玉. 基于位置信息和注意力机制的路面裂缝检测[J]. 计算机工程, 2024, 50(4): 303-312.

WANG Anzheng, DANG Jianwu, YUE Biao, YANG Jingyu. Road Crack Detection Based on Position Information and Attention Mechanism[J]. Computer Engineering, 2024, 50(4): 303-312.

https://www.ecice06.com/CN/Y2024/V50/I4/303

参考文献

[1] XIANG X Z, ZHANG Y Q, EL SADDIK A. Pavement crack detection network based on pyramid structure and attention mechanism[J]. IET Image Processing, 2020, 14(8):1580-1586.
[2] KANG D H, CHA Y J. Efficient attention-based deep encoder and decoder for automatic crack segmentation[J]. Structural Health Monitoring, 2022, 21(5):2190-2205.
[3] YAN K, ZHANG Z H. Automated asphalt highway pavement crack detection based on deformable single shot multi-box detector under a complex environment[J]. IEEE Access, 2021, 9:150925-150938.
[4] IBRAGIMOV E, LEE H J, LEE J J, et al. Automated pavement distress detection using region based convolutional neural networks[J]. International Journal of Pavement Engineering, 2022, 23(6):1981-1992.
[5] TRAN V P, TRAN T S, LEE H J, et al. One stage detector(RetinaNet)-based crack detection for asphalt pavements considering pavement distresses and surface objects[J]. Journal of Civil Structural Health Monitoring, 2021, 11(1):205-222.
[6] LUO H, LI J M, CAI L M, et al. STrans-YOLOX:fusing Swin Transformer and YOLOX for automatic pavement crack detection[J]. Applied Sciences, 2023, 13(3):1999.
[7] OLIVEIRA H, CORREIA P L. Automatic road crack segmentation using entropy and image dynamic thresholding[C]//Proceedings of the 17th European Signal Processing Conference. Washington D.C., USA:IEEE Press, 2009:622-626.
[8] 任亮, 徐志刚, 赵祥模, 等. 基于Prim最小生成树的路面裂缝连接算法[J]. 计算机工程, 2015, 41(1):31-36, 43. REN L, XU Z G, ZHAO X M, et al. Pavement crack connection algorithm based on Prim minimum spanning tree[J]. Computer Engineering, 2015, 41(1):31-36, 43.(in Chinese)
[9] SALMAN M, MATHAVAN S, KAMAL K, et al. Pavement crack detection using the Gabor filter[C]//Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems. Washington D.C., USA:IEEE Press, 2013:2039-2044.
[10] MEDINA R, LLAMAS J, ZALAMA E, et al. Enhanced automatic detection of road surface cracks by combining 2D/3D image processing techniques[C]//Proceedings of 2014 IEEE International Conference on Image Processing. Washington D.C., USA:IEEE Press, 2014:778-782.
[11] ZOU Q, ZHANG Z, LI Q, et al. DeepCrack:learning hierarchical convolutional features for crack detection[J]. IEEE Transactions on Image Processing, 2018, 28(3):1498-1512.
[12] FAN Z, WU Y, LU J, et al. Automatic pavement crack detection based on structured prediction with the convolutional neural network[J].[2023-05-11]. https://arxiv.org/abs/1802.02208.
[13] LAU S L H, CHONG E K P, YANG X, et al. Automated pavement crack segmentation using U-Net-based convolutional neural network[J]. IEEE Access, 2020, 8:114892-114899.
[14] GHOSH S, SINGH S, MAITY A, et al. CrackWeb:a modified U-Net based segmentation architecture for crack detection[C]//Proceedings of the 3rd International Conference on Advances in Mechanical Engineering and Its Interdisciplinary Areas.[S. l.]:IOP Publishing, 2021:012002.
[15] 于海洋, 景鹏, 张文涛, 等. 基于残差与注意力机制的道路裂缝检测U-Net改进模型[J]. 计算机工程, 2023, 49(6):265-273. YU H Y, JING P, ZHANG W T, et al. Improved U-Net model for road crack detection based on residual and attention mechanism[J]. Computer Engineering, 2023, 49(6):265-273.(in Chinese)
[16] 张伯树, 张志华, 张洋. 改进的HRNet应用于路面裂缝分割与检测[J]. 测绘通报, 2022(3):83-89. ZHANG B S, ZHANG Z H, ZHANG Y. Improved HRNet applied to segmentation and detection of pavement cracks[J]. Bulletin of Surveying and Mapping, 2022(3):83-89.(in Chinese)
[17] CHEN J N, LU Y Y, YU Q H, et al. TransUNet:Transformers make strong encoders for medical image segmentation[EB/OL].[2023-05-11]. https://arxiv.org/abs/2102.04306
[18] YANG Y M, MEHRKANOON S. AA-TransUNet:attention augmented TransUNet for nowcasting tasks[C]//Proceedings of International Joint Conference on Neural Networks. Washington D.C., USA:IEEE Press, 2022:1-8.
[19] VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. New York, USA:ACM Press, 2017:6000-6010.
[20] DOSOVITSKIY A, BEYER L, KOLESNIKOV A, et al. An image is worth 16×16 words:transformers for image recognition at scale[EB/OL].[2023-05-11]. https://arxiv.org/abs/2010.11929.
[21] OKTAY O, SCHLEMPER J, FOLGOC L L, et al. Attention U-Net:learning where to look for the pancreas[EB/OL].[2023-05-11]. https://arxiv.org/abs/1804.03999.
[22] SHI Y, CUI L M, QI Z Q, et al. Automatic road crack detection using random structured forests[J]. IEEE Transactions on Intelligent Transportation Systems, 2016, 17(12):3434-3445.
[23] ZOU Q, CAO Y, LI Q Q, et al. Cracktree:automatic crack detection from pavement images[J]. Pattern Recognition Letters, 2012, 33(3):227-238.
[24] CAO H B, GAO Y X, CAI W W, et al. Segmentation detection method for complex road cracks collected by UAV based on HC-UNet++[J]. Drones, 2023, 7(3):189.
[25] BADRINARAYANAN V, KENDALL A, CIPOLLA R. SegNet:a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12):2481-2495.
[26] RONNEBERGER O, FISCHER P, BROX T. U-Net:convolutional networks for biomedical image segmentation[C]//Proceedings of the 18th International Conference on Medical Image Computing and Computer. Berlin, Germany:Springer, 2015:234-241.
[27] LIU Y H, YAO J, LU X H, et al. DeepCrack:a deep hierarchical feature learning architecture for crack segmentation[J]. Neurocomputing, 2019, 338:139-153.

选择文件类型/文献管理软件名称

选择包含的内容

基于位置信息和注意力机制的路面裂缝检测

Road Crack Detection Based on Position Information and Attention Mechanism

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	李俊俊, 董建刚, 李坤. 基于Kubernetes的集群节能策略研究[J]. 计算机工程, 2024, 50(9): 82-91.
[2]	林畅, 郭伟, 任哲聪, 金海波. 基于Transformer的目标跟踪与分割统一算法[J]. 计算机工程, 2024, 50(9): 130-141.
[3]	李泽霖, 吕兆峰, 陈富强, 李克. 基于多跳信息融合的实体对齐模型[J]. 计算机工程, 2024, 50(9): 142-152.
[4]	王汝英, 马嘉骏, 董建强, 刘万龙, 张海涛, 尹凯, 赵博超. 基于MTS-BiGRU-DMHSA的工业负荷预测方法[J]. 计算机工程, 2024, 50(9): 169-178.
[5]	杨太龙, 赵红朋, 张磊. 基于国产异构平台的奇异值分解法[J]. 计算机工程, 2024, 50(9): 216-225.
[6]	朱凯, 李理, 张彤, 江晟, 别一鸣. 基于Transformer的多阶段运动模糊图像修复网络[J]. 计算机工程, 2024, 50(9): 276-285.
[7]	张天鹏, 韩晶, 吕学强. 基于多任务学习的超分辨率辅助小目标检测[J]. 计算机工程, 2024, 50(9): 304-312.
[8]	郭敏, 张熙涵, 李阳. 融合注意力的教师互一致性半监督医学图像分割[J]. 计算机工程, 2024, 50(9): 313-323.
[9]	曾钰琦, 刘博, 钟柏昌, 钟瑾. 智慧教育下基于改进YOLOv8的学生课堂行为检测算法[J]. 计算机工程, 2024, 50(9): 344-355.
[10]	饶日昕, 王怡文, 曾砺志, 童心恬, 赵海涛. 面向废旧电缆检测的轻量化网络模型[J]. 计算机工程, 2024, 50(8): 22-30.
[11]	李华昱, 张智康, 闫阳, 岳阳. 基于知识图谱增强的领域多模态实体识别[J]. 计算机工程, 2024, 50(8): 31-39.
[12]	王蕾, 党时鹏, 潘丰. 基于卷积神经网络的隐匿性旁路预测模型[J]. 计算机工程, 2024, 50(8): 40-49.
[13]	陈瀚, 赵春蕾, 蒋昊达, 王春东. 基于融合模型与语义网络的App用户意图识别研究[J]. 计算机工程, 2024, 50(8): 50-63.
[14]	李仲, 冒睿瑞, 王晓龙, 王根一, 安国成. 基于改进PIDNet的水位线检测算法[J]. 计算机工程, 2024, 50(8): 102-112.
[15]	闵莉, 董冰洁, 安冬. 基于多注意力机制与跨特征融合的语义分割算法[J]. 计算机工程, 2024, 50(8): 282-289.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于位置信息和注意力机制的路面裂缝检测

Road Crack Detection Based on Position Information and Attention Mechanism

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价