基于YOLOv8的无人机图像目标检测算法

doi:10.19678/j.issn.1000-3428.0068268

摘要/Abstract

摘要： 在无人机(UAV)目标检测任务中,存在因检测目标尺度小、检测图像背景复杂等原因导致的漏检、误检问题。针对上述问题,提出改进YOLOv8s的无人机图像目标检测算法。首先,针对无人机拍摄目标普遍为小目标的应用场景,减少算法骨干网络(Backbone)层数,增大待检测特征图尺寸,使得网络模型更专注于微小目标;其次,针对数据集普遍存在一定数量低质量示例影响训练效果的问题,引入Wise-IoU损失函数,增强数据集训练效果;再次,通过引入上下文增强模块,获得小目标在不同感受野下的特征信息,改善算法在复杂环境下对小目标的定位和分类效果;最后,设计空间-通道滤波模块,增强卷积过程中目标的特征信息,滤除无用的干扰信息,改善卷积过程中部分微小目标特征信息被淹没、丢失的现象。在VisDrone2019数据集上的实验结果表明,该算法的平均检测精度(mAP@0.5)达到45.4%,相较于原始YOLOv8s算法提高7.3个百分点,参数量减少26.13%。在相同实验条件下,相比其他常见小目标检测算法,检测精度和检测速度也有一定提升。

关键词: 目标检测, 无人机, 小目标, 滤波, 改进YOLOv8算法, 注意力机制

Abstract: In the Unmanned Aerial Vehicle(UAV) target detection task, missed and false detections are caused by the small size of the detection target and complex background of the detection image. To address the problem of small target detection, the UAV image target detection algorithm is proposed by improving YOLOv8s. First, for application scenarios where drone shooting targets are generally small, the number of Backbone layers of the algorithm is reduced, and the size of the feature map to be detected is increased such that the network model can focus more on small targets. Second, because a certain number of low-quality examples commonly influence the training effect in the dataset, the Wise-IoU loss function is introduced to enhance the training effect of the dataset. Third, by introducing a context enhancement module, the characteristic information of small targets in different receptive fields is obtained, and the positioning and classification effect of the network model on small targets in complex environments is improved. Finally, a spatial-channel filtering module is designed to enhance the characteristic information of the target during the convolution process to filter out useless interference information and address the problem of some small target characteristic information being submerged and lost during the convolution process. Experiment results on the VisDrone2019 dataset demonstrate that the average detection accuracy(mAP@0.5) of the proposed algorithm reaches 45.4%, which is 7.3 percentage points higher than that of the original YOLOv8s algorithm, and the number of parameters is reduced by 26.13%. Under similar experimental conditions, compared with other common small target detection algorithms, the detection accuracy and speed are improved to a certain extent.

Key words: target detection, Unmanned Aerial Vehicle(UAV), small target, filtering, improved YOLOv8 algorithm, attention mechanism

中图分类号:

TP391

赵继达, 甄国涌, 储成群. 基于YOLOv8的无人机图像目标检测算法[J]. 计算机工程, 2024, 50(4): 113-120.

ZHAO Jida, ZHEN Guoyong, CHU Chengqun. Unmanned Aerial Vehicle Image Target Detection Algorithm Based on YOLOv8[J]. Computer Engineering, 2024, 50(4): 113-120.

https://www.ecice06.com/CN/Y2024/V50/I4/113

参考文献

[1] 廖龙杰, 吕文涛, 叶冬, 等. 基于深度学习的小目标检测算法研究进展[J]. 浙江理工大学学报(自然科学版), 2023, 49(3):331-343. LIAO L J, LÜ W T, YE D, et al. Research progress of small target detection based on deep learning[J]. Journal of Zhejiang Sci-Tech University(Natural Sciences), 2023, 49(3):331-343. (in Chinese)
[2] 宁欣, 田伟娟, 于丽娜, 等. 面向小目标和遮挡目标检测的脑启发CIRA-DETR全推理方法[J]. 计算机学报, 2022, 45(10):2080-2092. NING X, TIAN W J, YU L N, et al. Brain-inspired CIRA-DETR full inference model for small and occluded object detection[J]. Chinese Journal of Computers, 2022, 45(10):2080-2092. (in Chinese)
[3] REDMON J, FARHADI A. YOLOv3:an incremental improvement[EB/OL].[2023-07-05]. https://arxiv.org/abs/1804.02767.
[4] ZHANG S F, ZHU X Y, LEI Z, et al. FaceBoxes:a CPU real-time face detector with high accuracy[C]//Proceedings of IEEE International Joint Conference on Biometrics. Washington D. C., USA:IEEE Press, 2017:1-9.
[5] LAW H, DENG J. CornerNet:detecting objects as paired keypoints[J]. International Journal of Computer Vision, 2020, 128(3):642-656.
[6] DUAN K W, BAI S, XIE L X, et al. CenterNet:keypoint triplets for object detection[C]//Proceedings of IEEE/CVF International Conference on Computer Vision. Washington D. C., USA:IEEE Press, 2019:6569-6578.
[7] 谢星星, 程塨, 姚艳清, 等. 动态特征融合的遥感图像目标检测[J]. 计算机学报, 2022, 45(4):735-747. XIE X X, CHENG G, YAO Y Q, et al. Dynamic feature fusion for object detection in remote sensing images[J]. Chinese Journal of Computers, 2022, 45(4):735-747. (in Chinese)
[8] LIM J S, ASTRID M, YOON H J, et al. Small object detection using context and attention[C]//Proceedings of International Conference on Artificial Intelligence in Information and Communication. Washington D. C., USA:IEEE Press, 2021:181-186.
[9] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial networks[J]. Communications of the ACM, 2020, 63(11):139-144.
[10] BAI Y C, ZHANG Y Q, DING M L, et al. SOD-MTGAN:small object detection via multi-task generative adversarial network[C]//Proceedings of the 15th European Conference on Computer Vision. Berlin, Germany:Springer, 2018:210-226.
[11] RABBI J, RAY N, SCHUBERT M, et al. Small-object detection in remote sensing images with end-to-end edge-enhanced GAN and object detector network[J]. Remote Sensing, 2020, 12(9):1432.
[12] KISANTAL M, WOJNA Z, MURAWSKI J, et al. Augmentation for small object detection[EB/OL].[2023-07-05]. https://arxiv.org/abs/1902.07296.
[13] ZOPH B, CUBUK E D, GHIASI G, et al. Learning data augmentation strategies for object detection[EB/OL].[2023-07-05]. https://arxiv.org/abs/1906.11172.
[14] ZENG N Y, WU P S, WANG Z D, et al. A small-sized object detection oriented multi-scale feature fusion approach with application to defect detection[J]. IEEE Transactions on Instrumentation Measurement, 2022, 71:3153997.
[15] JOCHER G. Ultralytics YOLOv8[EB/OL].[2023-07-05]. https://github.com/ultralytics/ultralytics,2023.01.10.
[16] 魏陈浩, 杨睿, 刘振丙, 等. 具有双层路由注意力的YOLOv8道路场景目标检测方法[J]. 图学学报,2023,44(6):1104-1111. WEI C H, YANG R, LIU Z B, et al. YOLOv8 roadscene target detection method with double-layer routing attention[J]. Journal of Graphics, 2023, 44(6):1104-1111. (in Chinese)
[17] TONG Z, CHEN Y, XU Z, et al. Wise-IoU:bounding box regression loss with dynamic focusing mechanism[EB/OL].[2023-07-05]. https://arxiv.org/abs/2301.10051.
[18] HOWARD A, SANDLER M, CHEN B, et al. Searching for MobileNetV3[C]//Proceedings of IEEE/CVF International Conference on Computer Vision. Washington D. C., USA:IEEE Press, 2019:1314-1324.
[19] LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[C]//Proceedings of IEEE International Conference on Computer Vision. Washington D. C., USA:IEEE Press, 2017:2980-2988.
[20] REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN:towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6):1137-1149.
[21] JOCHER G. YOLOv5[EB/OL].[2023-07-05]. https://github.com/ultralytics/yolov5.
[22] ZHU X, SU W, LU L, et al. Deformable DETR:deformable transformers for end-to-end object detection[EB/OL].[2023-07-05]. https://arxiv.org/abs/2010.04159.
[23] ZHU X K, LYU S C, WANG X, et al. TPH-YOLOv5:improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios[C]//Proceedings of IEEE/CVF International Conference on Computer Vision. Washington D. C., USA:IEEE Press, 2021:2778-2788.
[24] WANG C Y, BOCHKOVSKIY A, LIAO H Y M. YOLOv7:trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington D. C., USA:IEEE Press, 2023:7464-7475.
[25] MIN L T, FAN Z M, LV Q Y, et al. YOLO-DCTI:small object detection in remote sensing base on contextual transformer enhancement[J]. Remote Sensing, 2023, 15(16):3970.
[26] 于傲泽, 魏维伟, 王平, 等. 基于分块复合注意力的无人机小目标检测算法[J/OL]. 航空学报:1-12[2023-07-05]. http://kns.cnki.net/kcms/detail/11.1929.V.20230913.1505.014.html. YU A Z, WEI W W, WANG P, et al. Small target detection algorithm for UAV based on patch-wise co-attention[J/OL]. Acta Aeronautica et Astronautica Sinica:1-12[2023-07-05]. http://kns.cnki.net/kcms/detail/11.1929.V.20230913.1505.014.html. (in Chinese)

选择文件类型/文献管理软件名称

选择包含的内容