基于局部特征关联与全局注意力机制的行人重识别

doi:10.19678/j.issn.1000-3428.0059940

摘要/Abstract

摘要： 行人重识别的难点在于行人之间的结构信息差异较小导致特征难以区分。结合全局关系注意力机制与局部特征关联方法提出一种改进的特征关联算法。通过水平切分全局注意力机制的特征得到多个局部特征，并进行逐个关联识别，利用局部特征关联与全局语义信息提取关键特征信息。在此基础上，采用交叉熵与三元组损失函数训练处理后的局部特征。在CUHK03-Labeled、Market1501、DukeMTMC-reID数据集上的实验结果表明，该算法首位命中率分别为81.6%、95.6%、89.5%，相比GCP、MGN、BAS-reID等算法具有更强的识别能力与自适应性。

关键词: 行人重识别, 注意力机制, 神经网络, 局部特征关联, 自适应

Abstract: In person re-identification, the difference of structural information between pedestrians is minor, making it hard to distinguish between the pedestrians with similar overall features.To address the problem, an improved feature relation algorithm is proposed by combining global relation attention mechanism and local feature relations.The algorithm horizontally segments the features of the global attention mechanism to obtain multiple local features, which are subsequently related and recognized.Then the local feature relations and the global semantic information are used to extract key feature information.On this basis, the cross entropy and the triplet loss function are used to train the processed local features.The experimental results show that the proposed algorithm displays a first place accuracy of 81.6% on CUHK03-Labeled, 95.6% on Market1501, and 89.5% on DukeMTMC-reID, providing high recognition performance and adaptability.

Key words: person re-identification, attention mechanism, neural network, local feature relation, self-adaption

中图分类号:

TP391

李佳宾, 李学伟, 刘宏哲, 徐成. 基于局部特征关联与全局注意力机制的行人重识别[J]. 计算机工程, 2022, 48(1): 245-252.

LI Jiabin, LI Xuewei, LIU Hongzhe, XU Cheng. Person Re-Identification Based on Local Feature Relation and Global Attention Mechanism[J]. Computer Engineering, 2022, 48(1): 245-252.

https://www.ecice06.com/CN/Y2022/V48/I1/245

图/表 11

20220108123559

20220108123603

20220108123607

20220108123611

20220108123616

20220108123621

20220108123626

20220108123630

20220108123634

20220108123638

20220108123642

参考文献

[1] GENG M Y, WANG Y W, XIANG T, et al.Deep transfer learning for person re-identification[EB/OL].[2020-10-05].https://arxiv.org/abs/1611.05244.
[2] CHENG D, GONG Y H, ZHOU S P, et al.Person re-identification by multichannel parts-based CNN with improved triplet loss function[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:1335-1344.
[3] SUN Y F, CHENG C M, ZHANG Y H, et al.Circle loss:a unified perspective of pair similarity optimization[C]//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2020:1-10.
[4] 姜国权, 肖禛禛, 霍占强.融合RGB与灰度图像特征的行人再识别方法[J].计算机工程, 2020, 47(4):226-233, 240. JIANG G Q, XIAO Z Z, HUO Z Q.Pedestrian re-identification method combining RGB and grayscale image features[J].Computer Engineering, 2020, 47(4):226-233, 240.(in Chinese)
[5] QIAN X L, FU Y W, WANG W X, et al.Pose-normalized image generation for person re-identification[EB/OL].[2020-10-08].https://arxiv.org/abs/1712.02225v6.
[6] CHEN B H, DENG W H, HU J N.Mixed high-order attention network for person re-identification[C]//Proceedings of IEEE/CVF International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2019:1-10.
[7] FANG P F, ZHOU J M, ROY S, et al.Bilinear attention networks for person retrieval[C]//Proceedings of IEEE/CVF International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2019:8030-8039.
[8] FU Y, WANG X Y, WEI Y C, et al.STA:spatial-temporal attention for large-scale video-based person re-identification[EB/OL].[2020-10-05].https://arxiv.org/pdf/1811.04129.pdf.
[9] LI S, BAK S, CARR P, et al.Diversity regularized spatiotemporal attention for video-based person re-identification[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:369-378.
[10] WOO S, PARK J, LEE J Y, et al.CBAM:convolutional block attention module[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2018:3-19.
[11] WANG F, JIANG M Q, QIAN C, et al.Residual attention network for image classification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2017:3156-3164.
[12] ZHANG Z, LAN C, ZENG W, et al.Relation-aware global attention for person re-identification[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2020:3186-3195.
[13] SUN Y F, ZHENG L, YANG Y, et al.Beyond part models:person retrieval with refined part pooling (and a strong convolutional baseline)[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2018:480-496.
[14] 董亚超, 刘宏哲, 徐成.基于显著性多尺度特征协作融合的行人重识别方法[J].计算机工程, 2021, 47(6):234-244, 252. DONG Y C, LIU H Z, XU C.Person re-identification method based on saliency multi-scale feature collaborative fusion[J].Computer Engineering, 2021, 47(6):234-244, 252.(in Chinese)
[15] WEI L H, ZHANG S L, YAO H T, et al.Glad:global-local-alignment descriptor for pedestrian retrieval[C]//Proceedings of the 25th ACM International Conference on Multimedia.New York, USA:ACM Press, 2017:420-428.
[16] PARK H, HAM B.Relation network for person re-identification[EB/OL].[2020-10-06].https://arxiv.org/abs/1911.09318v2.
[17] 廖华年, 徐新.基于注意力机制的跨分辨率行人重识别[J].北京航空航天大学学报, 2021, 47(3):605-612. LIAO H N, XU X.Cross-resolution person re-identification based on attention mechanism[J].Journal of Beijing University of Aeronautics and Astronautics, 2021, 47(3):605-612.(in Chinese)
[18] 徐龙壮, 彭力, 朱凤增.多任务金字塔重叠匹配的行人重识别方法[J].计算机工程, 2021, 47(1):239-245, 254. XU L Z, PENG L, ZHU F Z.Person re-identification method based on multi-task pyramid overlapping matching[J].Computer Engineering, 2021, 47(1):239-245, 254(in Chinese).
[19] FU Y, WEI Y C, ZHOU Y Q, et al.Horizontal pyramid matching for person re-identification[EB/OL].[2020-10-07].https://arxiv.org/abs/1804.05275.
[20] LI W, ZHAO R, XIAO T, et al.Deepreid:deep filter pairing neural network for person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2014:152-159.
[21] ZHENG L, SHEN L Y, TIAN L, et al.Scalable person re-identification:a benchmark[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2015:1116-1124.
[22] RISTANI E, SOLERA F, ZOU R, et al.Performance measures and a data set for multi-target, multi-camera tracking[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2016:17-35.
[23] WANG G, YUAN Y, CHEN X, et al.Learning discriminative features with multiple granularities for person re-identification[C]//Proceedings of the 26th ACM International Conference on Multimedia.New York, USA:ACM Press, 2018:274-282.
[24] ZHANG Z, LAN C, ZENG W, et al.Densely semantically aligned person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2019:667-676.
[25] SUN Y, ZHENG L, DENG W, et al.SVDNet for pedestrian retrieval[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2017:3800-3808.
[26] HERMANS A, BEYER L, LEIBE B.In defense of the triplet loss for person re-identification[EB/OL].[2020-10-05].https://arxiv.org/abs/1703.07737v2.
[27] BAI X, YANG M, HUANG T, et al.Deep-person:learning discriminative deep features for person re-identification[EB/OL].[2020-10-05].https://arxiv.org/abs/1711.10658v4.

选择文件类型/文献管理软件名称

选择包含的内容