Efficient Livestock Detection in Grazing Areas Based on Enhanced Lightweight Deep Network

doi:10.19678/j.issn.1000-3428.0064802

Abstract

Abstract:

Realizing big data to manage livestock requires real-time monitoring of livestock, but real-time monitoring of livestock is easily interfered by large changes in target size, lighting, environmental factors, etc., so it is difficult to detection, and existing livestock detection algorithms have the problem of poor robustness.An object detection network called E-YOLOv4-tiny is proposed based on enhanced YOLOv4-tiny, which adopts a pyramid network with multi-scale feature fusion, taking into account shallow local detail features and deep semantic information to solve the problem of livestock size fluctuation in pastoral areas.The number of backbone network parameters is reduced by improving the residual structure to accommodate embedded platform requirements.A new composite clustering algorithm is introduced to design anchor frames to improve the accuracy of the algorithm under the premise of ensuring portability.Finally, according to the characteristics of a pastoral environment, a new Compound Muti-channel Attention(CMA) mechanism is proposed to improve the poor accuracy of the target detection network and enhance the robustness of the algorithm.Experimental results show that the mean Average Precision(mAP) of the E-YOLOv4-tiny algorithm is 0.878 9, and the frame rate is 32 frame/s, and it's mAP is 9.32% higher than that of the traditional YOLOv4-tiny algorithm while maintaining almost the same detection rate.

Key words: target detection, deep learning, computer vision, YOLOv4-tiny algorithm, attention mechanism, feature fusion

摘要：

实现大数据管理牲畜需要实时监测牲畜，但对牲畜进行实时监测容易受到目标尺寸变化大、光照、环境因素等干扰，因此检测难度大，现有牲畜检测算法存在鲁棒性差等问题。提出一种基于增强型YOLOv4-tiny的目标检测算法(E-YOLOv4-tiny)，采用多尺度特征融合的金字塔网络，兼顾浅层局部细节特征与深层语义信息，解决牧区牲畜尺寸波动问题。通过改进残差结构，减少主干网络参数量，以适应嵌入式平台需求。引入一种新的复合聚类算法设计锚框，在保证可移植性的前提下提高算法精度。针对牧区环境特点，提出一种新的复合多通道注意力机制，改善目标检测网络精度差的问题，增强算法鲁棒性。实验结果表明，E-YOLOv4-tiny算法的平均精度均值(mAP)为0.878 9，帧率为32帧/s，相较于传统YOLOv4-tiny算法，在保持几乎相同的检测速率条件下，mAP提升了9.32%。

关键词: 目标检测, 深度学习, 计算机视觉, YOLOv4-tiny算法, 注意力机制, 特征融合

Yongsheng QI, Xiaoxu DU, Junfeng ZHU, Shengli GAO, Liqiang LIU. Efficient Livestock Detection in Grazing Areas Based on Enhanced Lightweight Deep Network[J]. Computer Engineering, 2023, 49(7): 278-287.

齐咏生, 杜晓旭, 朱俊峰, 高胜利, 刘利强. 基于增强型轻量深度网络的牧区牲畜高效检测[J]. 计算机工程, 2023, 49(7): 278-287.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0064802

http://www.ecice06.com/EN/Y2023/V49/I7/278

Figures/Tables 14

Fig.1 Structure of E-YOLOv4-tiny network

Fig.2 Procedure of algorithm optimization

Fig.3 Principle of squeeze and excitation mechanism

Fig.4 Schematic diagram of CMA mechanism

Fig.5 Optimization of residual network module

Fig.6 Test platform in this paper

Table 1 Results of ablation experiment

锚框聚类算法			注意力机制		结构优化		性能指标
DBSCAN	K-means++	本文算法	SE	CMA	改进残差网络	多尺度预测	Loss函数均值	mAP	参数量/M
√	×	×	×	×	×	×	0.637	0.7971	23.5
×	√	×	×	×	×	×	0.511	0.8121	23.5
×	×	√	×	×	×	×	0.497	0.8283	23.5
×	×	√	√	×	×	×	0.474	0.8231	25.4
×	×	√	×	√	×	×	0.328	0.8598	27.8
×	×	√	×	√	√	×	0.331	0.8588	27.1
×	×	√	×	√	√	√	0.291	0.8789	29.4

Fig.7 Loss function curves of different algorithms

Fig.8 PR curves of different algorithms

Table 2 Comparison results of average Loss function value and mAP value of different algorithms

算法	Loss函数均值	mAP
YOLOv4	0.189 0	0.910 9
YOLOv4-tiny	0.637 0	0.803 9
E-YOLOv4-tiny	0.290 9	0.878 9
YOLOv5-S	—	0.859 0
YOLOX-S	—	0.861 0

Fig.9 Comparison of target detection effects of different algorithms for cows

Fig.10 Comparison of target detection effects of different algorithms for horses

Fig.11 Comparison of target detection effects of different algorithms for sheeps

Table 3 Comparison of parameters between different algorithms

算法	卷积层数	模型大小/MB	帧率/(帧·s^-1)
YOLOv4	162	256	8
YOLOv4-tiny	38	23.5	39
E-YOLOv4-tiny	61	27.4	32
YOLOv5-S	—	27.5	41
YOLOX-S	—	36.0	33

References 25

1	YI F, JEONG O, MOON I, et al. Deep learning integral imaging for three-dimensional visualization, object detection, and segmentation. Optics and Lasers in Engineering, 2021, 146(3): 106695- 106702.
2	HE K M, GKIOXARI G, DOLLÁR P, et al. Mask R-CNN[C]//Proceedings of IEEE International Conference on Computer Vision. Washington D. C., USA: IEEE Press, 2017: 2980-2988.
3	KIM C J, LEE M J, HWANG K H, et al. End-to-end deep learning-based autonomous driving control for high-speed environment. The Journal of Supercomputing, 2022, 78(2): 1961- 1982. doi: 10.1007/s11227-021-03929-8
4	LORENTE P J N, MILLER L, ROSIQUE F, et al. End-to-end deep neural network architectures for speed and steering wheel angle prediction in autonomous driving. Electronics, 2021, 10(11): 1266- 1272. doi: 10.3390/electronics10111266
5	XUE Y, JU Z. Multiple pedestrian tracking under first-person perspective using deep neural network and social force optimization. Optik, 2021, 240(6): 81- 92.
6	GAO H, WANG W, YANG C, et al. Traffic signal image detection technology based on YOLO. Journal of Physics: Conference Series, 2021, 61(1): 12- 21.
7	NIU H C, HU X B, LI H. Improved YOLOv5 network-based object detection for anti-intrusion of gantry crane[C]//Proceedings of the 2nd International Conference on Control, Robotics and Intelligent System. New York, USA: ACM, 2021: 147-152.
8	REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[C]//Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence. Washington D. C., USA: IEEE Press, 2016: 1137-1149.
9	兰玉彬, 赵德楠, 张彦斐, 等. 生态无人农场模式探索及发展展望. 农业工程学报, 2021, 37(9): 312- 327. URL
	LAN Y B, ZHAO D N, ZHANG Y F, et al. Exploration and development prospect of eco-unmanned farm modes. Transactions of the Chinese Society of Agricultural Engineering, 2021, 37(9): 312- 327. URL
10	王斯佳. 基于智能项圈的畜牧健康诊断算法的研究[D]. 哈尔滨: 哈尔滨工业大学, 2019.
	WANG S J. Research on animal husbandry health diagnosis algorithm based on smart collar[D]. Harbin: Harbin Institute of Technology, 2019. (in Chinese)
11	张磊, 许静, 田在, 等. 牧区智能数羊器系统的设计与实现. 通信电源技术, 2017, 34(4): 165- 166. URL
	ZHANG L, XU J, TIAN Z, et al. Research and implementation of intelligent counting sheep system in pastoral areas. Telecom Power Technology, 2017, 34(4): 165- 166. URL
12	TASSINARI P, BOVO M, BENNI S, et al. A computer vision approach based on deep learning for the detection of dairy cows in free stall barn. Computers and Electronics in Agriculture, 2021, 182(7): 30- 38.
13	WU D, WU Q, YIN X, et al. Lameness detection of dairy cows based on the YOLOv3 deep learning algorithm and a relative step size characteristic vector. Biosystems Engineering, 2020, 189(11): 150- 163.
14	ACHOUR B, BELKADI M, FILALI I, et al. Image analysis for individual identification and feeding behaviour monitoring of dairy cows based on convolutional neural networks. Biosystems Engineering, 2020, 198(7): 31- 49.
15	MA L Z, CHEN Y, ZHANG J L. Vehicle and pedestrian detection based on improved YOLOv4-tiny model. Journal of Physics: Conference Series, 2021, 1920(1): 34- 43.
16	HUANG B Q, LIN H P, HU Z J, et al. An improved YOLOv3-tiny algorithm for vehicle detection in natural scenes. IET Cyber-Systems and Robotics, 2021, 32(3): 256- 264.
17	GUO C, LV X L, ZHANG Y, et al. Improved YOLOv4-tiny network for real-time electronic component detection. Scientific Reports, 2021, 11(1): 44- 56. doi: 10.1038/s41598-020-78528-3
18	LEE G, HONG S, CHO D. Self-supervised feature enhancement networks for small object detection in noisy images. IEEE Signal Processing Letters, 2021, 28(7): 1026- 1030.
19	MA A L, WANG J J, ZHONG Y F, et al. FactSeg: foreground activation-driven small object semantic segmentation in large-scale remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60(12): 1- 16.
20	ZHANG Y, LI K. Image super-resolution using very deep residual channel attention networks[EB/OL]. [2022-04-20]. https://arxiv.org/abs/1807.02758.
21	WANG C Y, MARK LIAO H Y, WU Y H, et al. CSPNet: a new backbone that can enhance learning capability of CNN[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Washington D. C., USA: IEEE Press, 2020: 1571-1580.
22	BOCHKOVSKIY A, WANG C Y, LIAO H Y M. YOLOv4: optimal speed and accuracy of object detection[EB/OL]. [2022-04-20]. https://arxiv.org/abs/2004.10934.
23	宋怀波, 江梅, 王云飞, 等. 融合卷积神经网络与视觉注意机制的苹果幼果高效检测方法. 农业工程学报, 2021, 37(9): 297- 303. URL
	SONG H B, JIANG M, WANG Y F, et al. Efficient detection method for young apples based on the fusion of convolutional neural network and visual attention mechanism. Transactions of the Chinese Society of Agricultural Engineering, 2021, 37(9): 297- 303. URL
24	GLENN J. YOLOV5. https://github.com/ultralytics/yolov5.
25	GE Z, LIU S, WANG F, et al. YOLOX: exceeding YOLO series in 2021[EB/OL]. [2022-04-20]. https://arxiv.org/abs/2107.08430.

[1]	Fangyu FENG, Xiaoshu LUO, Zhiming MENG, Guangyu WANG. Facial Expression Recognition Based on Anti-Aliasing Residual Attention Network [J]. Computer Engineering, 2023, 49(8): 190-198.
[2]	Chunbo XU, Juan YAN, Huibin YANG, Bo WANG, Han WU. Visual SLAM Algorithm Based on Target Detection and Semantic Segmentation [J]. Computer Engineering, 2023, 49(8): 199-206, 214.
[3]	Shupeng WANG, Yindi HE. Uneven Illumination Image Enhancement Algorithm Fusing Feature Attention Mechanism [J]. Computer Engineering, 2023, 49(8): 232-239.
[4]	Xinyi ZHANG, Fei ZHANG, Bin HAO, Lu GAO, Xiaoying REN. Mask Wearing Detection Algorithm Based on Improved YOLOv5 [J]. Computer Engineering, 2023, 49(8): 265-274.
[5]	Yuyan JIANG, Chengfeng TAO, Ping LI. Deep Subspace Clustering Algorithm with Data Augmentation and Adaptive Self-Paced Learning [J]. Computer Engineering, 2023, 49(8): 96-103, 110.
[6]	Zhina SONG, Sha LI, Jianming YANG, Chuan XU. Remote Sensing Ship Target Detection Based on Feature and Region Localization Enhancement [J]. Computer Engineering, 2023, 49(8): 257-264.
[7]	Haoxin LIU, Chao DONG, Zhinan GOU, Kai GAO. Few-Shot Relation Extraction Method Fusing with Hybrid Representation [J]. Computer Engineering, 2023, 49(8): 63-68.
[8]	Zeshui LI, Junzhong JI, Cuicui YANG. Functional Module Detection Based on Deep Network Embedding of Edge Weighing Information in PPIN [J]. Computer Engineering, 2023, 49(8): 69-76.
[9]	Changpei YANG, Liefa LIAO. Chinese Named Entity Recognition Based on Dilated Gated Convolution Feature Fusion [J]. Computer Engineering, 2023, 49(8): 85-95.
[10]	Kezheng WANG, Yufeng XU, Shangbo ZHOU. Image Dehazing Model Combined with Contrastive Perceptual Loss and Fusion Attention [J]. Computer Engineering, 2023, 49(8): 207-214.
[11]	Zuhe YANG, Zhihui LI, Yunqi TANG, Yuwen YAN, Huaqing SONG. Pedestrian Attribute Recognition Algorithm Combining Semantic and Image Information [J]. Computer Engineering, 2023, 49(8): 215-222, 231.
[12]	Junhao LIU, Meilin WANG, Xing XIE, Yexing SONG, Lihua XU. Leather Defect Detection Algorithm Based on Improved YOLOv5 [J]. Computer Engineering, 2023, 49(8): 240-249.
[13]	Na MA, Tingxin WEN, Xu JIA, Xiaohui LI. Adaptive Vehicle Face Re-identification Model Under Complex Illumination Conditions [J]. Computer Engineering, 2023, 49(8): 275-282, 290.
[14]	Lumeng CHEN, Yanyan CAO, Min HUANG, Xingang XIE. Flame Detection Method Based on Improved YOLOv5 [J]. Computer Engineering, 2023, 49(8): 291-301, 309.
[15]	Qianglong LI, Xinwen ZHOU, Meng'en WEI, Yangzhou GAN. Infrared Target Detection Algorithm Based on Strip Pooling and Attention Mechanism in Street Scene [J]. Computer Engineering, 2023, 49(8): 310-320.

Please choose a citation manager

Content to export