Edge Refinement Detection of Camouflage Targets Based on Deep Texture Features

doi:10.19678/j.issn.1000-3428.0068431

Abstract

Abstract:

To solve the problem of incomplete spatial information and fuzzy target boundaries in conventional Camouflage Object Detection (COD), a COD algorithm based on depth texture features and edge thinning is proposed. Based on the texture difference and edge details of the target, the algorithm designs Context Texture Difference Amplification Module (CTDAM), Feature Boundary Search Module (FBSM), and Boundary Inference Module (BIM). CTDAM uses global receptive field coverage and parallel multi-branch hybrid convolution to highlight the texture differences of occluded camouflage targets. Additionally, it introduces local attention and position channel perception to guide feature cross-layer fusion in Attention Feature Fusion Module (AFFM). Therefore, it achieves the effect of balancing local information and enhancing semantic information of global context. FBSM uses a self-attention mechanism to combine low- and high-level features to deal with the dependence between different boundary pixels; and BIM uses the boundary guidance factor provided by FBSM to guide the fusion features to infer the real target and refine the edge details. Quantitative and qualitative experiments are conducted on the CAMO, CHAMELEON, and COD 10K datasets using four objective evaluation indices. The results demonstrate that the proposed algorithm is superior to other eight algorithms. On the COD 10K dataset, the Mean Absolute Error (MAE) is 0.034.

Key words: Camouflage Object Detection(COD), feature boundary search, attention feature fusion, context information, texture difference

摘要：

为解决传统伪装目标检测(COD)出现的空间信息不完整和目标边界模糊的问题, 提出一种基于深度纹理特征的伪装目标边缘细化检测算法。该算法针对目标的纹理差异和边缘细节设计上下文纹理差异放大模块(CTDAM)、特征边界搜寻模块(FBSM)和边界推理模块(BIM)。CTDAM利用全局感受野覆盖和并行多分支混合卷积方式突出被遮挡的伪装目标的纹理差异; 在注意力特征融合模块(AFFM)中引入局部注意力和位置通道感知并行注意力指导特征跨层融合, 达到平衡局部信息和增强全局上下文语义信息的效果; FBSM利用自注意力机制将低层与高层特征相结合, 处理不同边界像素点之间的依赖关系; BIM利用FBSM所提供的边界指导因子, 指导融合后的特征推断出真实目标并细化边缘细节。在CAMO、CHAMELEON和COD 10K数据集上利用4个客观评估指标进行定量和定性实验, 结果表明, 该算法的检测性能优于对比的8种先进算法, 在COD 10K数据集上, 其平均绝对误差(MAE)达到了0.034。

关键词: 伪装目标检测, 特征边界搜寻, 注意力特征融合, 上下文信息, 纹理差异

YUAN Hao, GE Haibo, XIN Shiao, XU Dongmei, YANG Yudi. Edge Refinement Detection of Camouflage Targets Based on Deep Texture Features[J]. Computer Engineering, 2024, 50(10): 89-99.

袁昊, 葛海波, 辛世澳, 胥冬梅, 杨雨迪. 基于深度纹理特征的伪装目标边缘细化检测[J]. 计算机工程, 2024, 50(10): 89-99.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0068431

https://www.ecice06.com/EN/Y2024/V50/I10/89

Figures/Tables 8

Fig.1 　The framework of BTNet

Fig.2 　CTDAM module structure

Fig.3 　AFFM module structure

Fig.4 　BIM module structure

Fig.5 　Qualitative comparison results of each method

Fig.6 　Results of efficiency comparison of each method

References 39

1	LIU J J, HOU Q B, CHENG M M, et al. A simple pooling-based design for real-time salient object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2019: 3917-3926.
2	JI G P, FU K R, WU Z, et al. Full-duplex strategy for video object segmentation[C]//Proceedings of IEEE/CVF International Conference on Computer Vision. Washington D. C., USA: IEEE Press, 2021: 4922-4933.
3	ZHAO J X, LIU J J, FAN D P, et al. EGNet: edge guidance network for salient object detection[C]//Proceedings of IEEE/CVF International Conference on Computer Vision. Washington D. C., USA: IEEE Press, 2019: 8779-8788.
4	QIN X B, ZHANG Z C, HUANG C Y, et al. BASNet: boundary-aware salient object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2019: 7479-7489.
5	ZHOU T, ZHOU Y, GONG C, et al. Feature aggregation and propagation network for camouflaged object detection. IEEE Transactions on Image Processing, 2022, 31, 7036- 7047. doi: 10.1109/TIP.2022.3217695
6	CHENG X L, XIONG H, FAN D P, et al. Implicit motion handling for video camouflaged object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2022: 13864-13873.
7	YAN J N, LE T N, NGUYEN K D, et al. MirrorNet: bio-inspired camouflaged object segmentation. IEEE Access, 2021, 9, 43290- 43300. doi: 10.1109/ACCESS.2021.3064443
8	LI A X, ZHANG J, LÜ Y Q, et al. Uncertainty-aware joint salient object and camouflaged object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2021: 10071-10081.
9	ZHAI Q, LI X, YANG F, et al. Mutual graph learning for camouflaged object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2021: 12997-13007.
10	PANG Y W, ZHAO X Q, XIANG T Z, et al. Zoom in and out: a mixed-scale triplet network for camouflaged object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2022: 2160-2170.
11	PENG Y K, LIU X Q, ZHAO M Z, et al. Research on camouflage object detection based on improved YOLOv5s[C]//Proceedings of the 8th Annual International Conference on Network and Information Systems for Computers. Washington D. C., USA: IEEE Press, 2022: 644-648.
12	CHOU M C, CHEN H J, SHUAI H H. Finding the Achilles heel: progressive identification network for camouflaged object detection[C]//Proceedings of IEEE International Conference on Multimedia and Expo. Washington D. C., USA: IEEE Press, 2022: 1-6.
13	ZADEH A, CHEN M, PORIA S, et al. Tensor fusion network for multimodal sentiment analysis[EB/OL]. [2023-08-05]. https://arxiv.org/abs/1707.07250.
14	ZHOU Z W, SIDDIQUEE M M R, TAJBAKHSH N, et al. UNet++: a nested U-Net architecture for medical image segmentation[EB/OL]. [2023-08-05]. https://link.springer.com/chapter/10.1007/978-3-030-00889-5_1.
15	ZHOU X W, GUO Y, HE W H, et al. Hierarchical attentional feature fusion for surgical instrument segmentation[C]//Proceedings of the 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society. Washington D. C., USA: IEEE Press, 2021: 3061-3065.
16	ZHANG P P, WANG D, LU H C, et al. Amulet: aggregating multi-level convolutional features for salient object detection[C]//Proceedings of IEEE International Conference on Computer Vision. Washington D. C., USA: IEEE Press, 2017: 202-211.
17	HU K, ZHANG X, LEE D J, et al. Boundary-guided and region-aware network with global scale-adaptive for accurate segmentation of breast tumors in ultrasound images. IEEE Journal of Biomedical and Health Informatics, 2023, 27 (9): 4421- 4432. doi: 10.1109/JBHI.2023.3285789
18	ZHAO C H, SHEN Y, SU N, et al. Gully erosion monitoring based on semi-supervised semantic segmentation with boundary-guided pseudo-label generation strategy and adaptive loss function. Remote Sensing, 2022, 14 (20): 5110. doi: 10.3390/rs14205110
19	XIAO J, CHEN T Y, HU X G, et al. Boundary-guided context-aware network for camouflaged object detection. Neural Computing and Applications, 2023, 35 (20): 15075- 15093. doi: 10.1007/s00521-023-08502-3
20	ZHENG Q P, ZHENG L, DENG J K, et al. Transformer-based hierarchical dynamic decoders for salient object detection. Knowledge-Based Systems, 2023, 282, 111075. doi: 10.1016/j.knosys.2023.111075
21	李军侠, 王星驰, 殷梓, 等. 边缘深度挖掘的弱监督显著性目标检测. 计算机工程, 2023, 49 (7): 169- 178.
	LI J X, WANG X C, YIN Z, et al. Weakly supervised salient object detection via edge depth mining. Computer Engineering, 2023, 49 (7): 169- 178.
22	WANG X, DING J J, ZHANG Z, et al. IPNet: polarization-based camouflaged object detection via dual-flow network. Engineering Applications of Artificial Intelligence, 2024, 127, 107303. doi: 10.1016/j.engappai.2023.107303
23	LIANG Y H, QIN G H, SUN M H, et al. A systematic review of image-level camouflaged object detection with deep learning. Neurocomputing, 2024, 566, 127050. doi: 10.1016/j.neucom.2023.127050
24	SHI C J, REN B J, CHEN H R, et al. Camouflaged object detection based on context-aware and boundary refinement. Applied Intelligence, 2023, 53 (19): 22429- 22445. doi: 10.1007/s10489-023-04645-x
25	PANG Y W, ZHAO X Q, ZHANG L H, et al. Multi-scale interactive network for salient object detection[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2020: 9413-9422.
26	XU X Q, CHEN S H, LÜ X, et al. Guided multi-scale refinement network for camouflaged object detection. Multimedia Tools and Applications, 2023, 82 (4): 5785- 5801. doi: 10.1007/s11042-022-13274-4
27	TANKUS A, YESHURUN Y. Convexity-based visual camouflage breaking. Computer Vision and Image Understanding, 2001, 82 (3): 208- 237. doi: 10.1006/cviu.2001.0912
28	曹健, 陈怡梅, 李海生, 等. 基于深度学习的道路小目标检测综述. 计算机工程, 2023, 49 (10): 1- 12.
	CAO J, CHEN Y M, LI H S, et al. Survey of small target detection on roads based on deep learning. Computer Engineering, 2023, 49 (10): 1- 12.
29	ZHANG C, BI H B, XIANG T Z, et al. Collaborative camouflaged object detection: a large-scale dataset and benchmark. IEEE Transactions on Neural Networks and Learning Systems, 2024, 15, 1- 15.
30	ZHANG C W, LI X D, LI X D. Decode after filtering: a network for camouflage object segmentation[J]. Soft Computing, 2022, 26(4): 2033-2043.
31	MEI H Y, JI G P, WEI Z Q, et al. Camouflaged object segmentation with distraction mining[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2021: 8772-8781.
32	FAN D P, JI G P, CHENG M M, et al. Concealed object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44 (10): 6024- 6042. doi: 10.1109/TPAMI.2021.3085766
33	LÜ Y Q, ZHANG J, DAI Y C, et al. Simultaneously localize, segment and rank the camouflaged objects[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2021: 11591-11601.
34	CHEN G, LIU S J, SUN Y J, et al. Camouflaged object detection via context-aware cross-level fusion. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32 (10): 6981- 6993. doi: 10.1109/TCSVT.2022.3178173
35	LIU K, QIU T, YU Y, et al. Edge-guided camouflaged object detection via multi-level feature integration. Sensors (Basel), 2023, 23 (13): 5789. doi: 10.3390/s23135789
36	ZHU H W, LI P, XIE H R, et al. I can find you! boundary-guided separated attention network for camouflaged object detection. Proceedings of the AAAI Conference on Artificial Intelligence, 2022, 36 (3): 3608- 3616. doi: 10.1609/aaai.v36i3.20273
37	JI G P, FAN D P, CHOU Y C, et al. Deep gradient learning for efficient camouflaged object detection. Machine Intelligence Research, 2023, 20 (1): 92- 108. doi: 10.1007/s11633-022-1365-9
38	ZHANG Q, GE Y L, ZHANG C, et al. TPRNet: camouflaged object detection via transformer-induced progressive refinement network. The Visual Computer, 2023, 39 (10): 4593- 4607. doi: 10.1007/s00371-022-02611-1
39	戚玲珑, 高建瓴. 基于改进YOLOv7的小目标检测. 计算机工程, 2023, 49 (1): 41- 48.
	QI L L, GAO J L. Small object detection based on improved YOLOv7. Computer Engineering, 2023, 49 (1): 41- 48.

[1]	WEN Jing, YANG Jie. Depth Estimation Based on Scene Object Attention and Depth Map Fusion [J]. Computer Engineering, 2023, 49(2): 222-230.
[2]	LU Zhengjun,FANG Yong,LIU Liang,ZHANG Wenjie,ZUO Zheng. Android Malicious Behavior Detection Method Based on Context Information [J]. Computer Engineering, 2018, 44(7): 150-155.
[3]	ZHU Jing-hua,WANG Xiao-ling. XML Keyword Search Based on Extended Query Expression [J]. Computer Engineering, 2014, 40(10): 25-31.
[4]	LI Han, WU Ai-Sheng. Shadow Detection Method with Color Correlation and Texture Difference [J]. Computer Engineering, 2011, 37(15): 146-148.

Please choose a citation manager

Content to export