基于姿态引导对齐网络的局部行人再识别

doi:10.19678/j.issn.1000-3428.0056642

摘要/Abstract

摘要： 将局部行人再识别中的局部图像与整体图像直接进行比较会产生严重的空间错位，从而导致无法检测到正确目标。针对相同尺寸的行人局部图像与全局图像不匹配问题，提出姿态引导对齐网络（PGAN）模型，将姿态作为辅助信息引入到姿态引导的空间变换模块中，从局部图像与整体图像中提取仿射变换后的行人图像并将其与标准姿态进行对齐，再利用卷积神经网络学习相关特征实现局部行人再识别。实验结果表明，在Partial-REID数据集上PGAN模型取得65%的Rank-1准确率，相比直接使用深度卷积神经网络提取全局特征进行匹配的基准模型提高了3.7%，从而证明其具有良好的局部图像对齐能力及行人再识别效果。

关键词: 局部行人再识别, 对齐网络, 空间变换, 姿态, 深度卷积神经网络

Abstract: In partial pedestrian re-identification,serious spatial misalignment will be caused when the partial image of a pedestrian is directly compared with the holistic image,leading to a failure in target detection.To solve the mismatch of the partial pedestrian image and the holistic image of the same size,this paper proposes a Pose-Guided Alignment Network(PGAN) model.The PGAN firstly introduces the pose into Pose-Guided Spatial Transformation(PST) module as auxiliary information,extracts the pedestrian image after affine transformation from the partial image and holistic image,and compares the pedestrian image with the standard pose.Then the Convolutional Neural Network(CNN) is used to learn the features for partial pedestrian re-identification.Experimental results on the Partial-REID dataset show that the rank-1 accuracy of the PGAN model reaches 65%,which is 3.7% higher than that of the baseline model that directly extracts the global features with Deep Convolutional Neural Network(DCNN).The results demonstrate the proposed model has excellent performance in partial image alignment and pedestrian re-identification.

Key words: partial pedestrian re-identification, alignment network, spatial transformation, pose, Deep Convolutional Neural Network(DCNN)

中图分类号:

TP311

郑烨, 赵杰煜, 王翀, 张毅. 基于姿态引导对齐网络的局部行人再识别[J]. 计算机工程, 2020, 46(5): 247-253.

ZHENG Ye, ZHAO Jieyu, WANG Chong, ZHANG Yi. Partial Pedestrain Re-Identification Based on Pose-Guided Alignment Network[J]. Computer Engineering, 2020, 46(5): 247-253.

http://www.ecice06.com/CN/Y2020/V46/I5/247

图/表 8

20200513204829

20200513204833

20200513204837

20200513204841

20200513204845

20200513204848

20200513204853

20200513204857

参考文献

[1] LI Wei,ZHAO Rui,XIAO Tong,et al.DeepReID:deep filter pairing neural network for person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2014:152-159.
[2] AHMED E,JONES M,MARKS T K.An improved deep learning architecture for person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2015:3908-3916.
[3] CHENG De,GONG Yihong,ZHOU Sanping,et al.Person re-identification by multi-channel parts-based CNN with improved triplet loss function[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2016:1335-1344.
[4] SUN Yifan,ZHENG Liang,YANG Yi,et al.Beyond part models:person retrieval with refined part pooling(and a strong convolutional baseline)[C]//Proceedings of European Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2018:480-496.
[5] KALAYEH M M,BASARAN E,GÖKMEN M,et al.Human semantic parsing for person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2018:1062-1071.
[6] JADERBERG M,SIMONYAN K,ZISSERMAN A.Spatial transformer networks[EB/OL].[2019-10-12].https://arxiv.org/abs/1506.02025.
[7] LI Dangwei,CHEN Xiaotang,ZHANG Zhang,et al.Learning deep context-aware features over body and latent parts for person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2017:384-393.
[8] ZHENG Zhedong,ZHENG Liang,YANG Yi.Pedestrian alignment network for large-scale person re-identification[J].IEEE Transactions on Circuits and Systems for Video Technology,2018,29(10):3037-3045.
[9] ZHAO Haiyu,TIAN Maoqing,SUN Shuyang,et al.Spindle Net:person re-identification with human body region guided feature decomposition and fusion[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2017:1077-1085.
[10] WEI Longhui,ZHANG Shiliang,YAO Hantao,et al.Glad:global-local-alignment descriptor for pedestrian retrieval[C]//Proceedings of the 25th ACM International Conference on Multimedia.New York,USA:ACM Press,2017:420-428.
[11] SU Chi,LI Jianing,ZHANG Shiliang,et al.Pose-driven deep convolutional model for person re-identification[C]//Proceedings of 2017 IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2017:3980-3989.
[12] ZHENG Liang,HUANG Yujia,LU Huchuan,et al.Pose invariant embedding for deep person re-identification[EB/OL].[2019-10-12].https://arxiv.org/abs/1701.07732.
[13] SAQUIB M,SCHUMANN A,EBERLE A,et al.A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2018:420-429.
[14] ZHENG Weishi,LI Xiang,XIANG Tao,et al.Partial person re-identification[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2015:4678-4686.
[15] HE Lingxiao,LIANG Jian,LI Haiqing,et al.Deep spatial feature reconstruction for partial person re-identification:alignment-free approach[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2018:7073-7082.
[16] SUN Yifan,XU Qin,LI Yali,et al.Perceive where to focus:learning visibility-aware part-level features for partial person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2019:393-402.
[17] HE Kaiming,ZHANG Xiangyu,REN Shaoqing,et al.Deep residual learning for image recognition[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2016:770-778.
[18] FANG Shaoshu,XIE Shuqin,TAI Yuying,et al.RMPE:regional multi-person pose estimation[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2017:2334-2343.
[19] ZHENG Liang,SHEN Liyue,TIAN Lu,et al.Scalable person re-identification:a benchmark[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2015:1116-1124.
[20] ZHENG W S,GONG S,XIANG T.Person re-identification by probabilistic relative distance comparison[C]//Proceedings of CVPR'11.Washington D.C.,USA:IEEE Press,2011:649-656.
[21] LUO Hao,GU Youzhi,LIAO Xingyu,et al.Bag of tricks and a strong baseline for deep person re-identification[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops.Washington D.C.,USA:IEEE Press,2019:1-7.

选择文件类型/文献管理软件名称

选择包含的内容