基于UV贴图优化人体特征的行人重识别

doi:10.19678/j.issn.1000-3428.0063288

摘要/Abstract

摘要： 现有行人重识别研究大多关注人体在二维平面的特征表示，而在现实社会中，人体以一种对称的三维结构存在，三维人体结构相较二维平面像素含有更多的体型、姿态等特征，仅研究二维平面上的行人特征限制了计算机对人体特征的理解。利用人体是一种三维对称的刚体结构这一先验事实，提出一种基于UV贴图优化人体特征的行人重识别方法。对图像底库进行数据预处理，通过数据增广方法生成更多的训练数据，对预处理后的图片进行特征提取，将特征矩阵解耦为姿态、色彩、形状以及视角参数，利用参数信息调整预定义的人体模型以得到重构后的三维人体模型。将重构后的三维人体模型转化为UV贴图，即将人体特征从三维空间映射到二维平面，同时对UV贴图进行优化从而丰富人体特征。使用UV贴图训练三维行人重识别网络模型，利用后处理的方法对输出结果做进一步优化，以得到最终的行人重识别结果。在Market-1501数据集上的实验结果表明，该方法的rank-1准确率和mAP分别达到94.76%和82.53%，相较OG-Net模型分别提升13.82%和22.56%。

关键词: 计算机视觉, 深度学习, 行人重识别, 三维重构, UV贴图

Abstract: Most previous person re-identification studies focused on the feature representation of the human body in the two-dimensional plane.However, in reality, the human body has a symmetrical three-dimensional structure.The three-dimensional structure of the human body shows more features, such as body shape and posture than two-dimensional plane pixels.Analyzing a person's features in the two-dimensional plane limits the computer's understanding of human characteristics.As the human body has a three-dimensional symmetrical rigid-body structure, a person re-identification method based on UV map for optimizing human features is proposed in this study.Data preprocessing on the image base is performed, additional training data are generated using the data augmentation method, the features of the preprocessed images are extracted, the feature matrix is decoupled into pose, color, shape, and angle of view parameters, and the predefined human model is adjusted using parameter information to establish the reconstructed three-dimensional human model.The reconstructed three-dimensional human body model is transformed into a UV map;that is, human features are mapped from the three-dimensional space to a two-dimensional plane and optimized to enhance human features.The three-dimensional person re-identification network model is trained using UV maps, and the output results are further optimized using post-processing methods to obtain the final person re-identification results.The experimental results show that on the Market-1501 dataset, the rank-1 accuracy and mean Average Precision(mAP) of the proposed method reach 94.76% and 82.53%, respectively.Compared with the OG-Net model, the rank-1 detection accuracy and mAP of person re-identification of this method improve by 13.82% and 22.56%, respectively.

Key words: computer vision, deep learning, person re-identification, 3D reconstruction, UV map

中图分类号:

TP391.4

徐智明, 戚湧. 基于UV贴图优化人体特征的行人重识别[J]. 计算机工程, 2022, 48(11): 83-88,95.

XU Zhiming, QI Yong. Person Re-Identification Based on UV Map for Optimizing Human Features[J]. Computer Engineering, 2022, 48(11): 83-88,95.

http://www.ecice06.com/CN/Y2022/V48/I11/83

图/表 9

20230203202724

20230203202727

20230203202730

20230203202734

20230203202738

20230203202741

20230203202745

20230203202749

20230203202752

参考文献

[1] WANG L W, ZHANG Y, FENG J F.On the Euclidean distance of images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(8):1334-1339.
[2] MAESSCHALCK R D, JOUAN-RIMBAUD D, MASSART D L.The mahalanobis distance[J].Chemometrics and Intelligent Laboratory Systems, 2000, 50(1):1-18.
[3] CHENG D, GONG Y H, ZHOU S P, et al.Person re-identification by multi-channel parts-based CNN with improved Triplet Loss function[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:1335-1344.
[4] LIN T Y, GOYAL P, GIRSHICK R, et al.Focal loss for dense object detection[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2017:2999-3007.
[5] SUN Y F, CHENG C M, ZHANG Y H, et al.Circle Loss:a unified perspective of pair similarity optimization[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2020:6397-6406.
[6] SUN Y, ZHENG L, YANG Y, et al.Beyond part models:person retrieval with refined part pooling(and a strong convolutional baseline)[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2018:480-496.
[7] WANG G S, YUAN Y F, CHEN X, et al.Learning discriminative features with multiple granularities for person re-identification[C]//Proceedings of the 26th ACM International Conference on Multimedia.New York, USA:ACM Press, 2018:274-282.
[8] FU Y, WANG X Y, WEI Y C, et al.STA:spatial-temporal attention for large-scale video-based person re-identification[J].Proceedings of the AAAI Conference on Artificial Intelligence, 2019, 33:8287-8294.
[9] CHEN T L, DING S J, XIE J Y, et al.ABD-net:attentive but diverse person re-identification[C]//Proceedings of IEEE/CVF International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2019:8350-8360.
[10] ZHENG Z D, YANG X D, YU Z D, et al.Joint discriminative and generative learning for person re-identification[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2019:2133-2142.
[11] LOPER M, MAHMOOD N, ROMERO J, et al.SMPL:a skinned multi-person linear model[J].ACM Transactions on Graphics, 2015, 34(6):248.
[12] PAVLAKOS G, CHOUTAS V, GHORBANI N, et al.Expressive body capture:3D hands, face, and body from a single image[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2019:10967-10977.
[13] CHEN Y J, TU Z G, KANG D, et al.Model-based 3D hand reconstruction via self-supervised learning[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2021:10446-10455.
[14] KOLOTOUROS N, PAVLAKOS G, BLACK M, et al.Learning to reconstruct 3D human pose and shape via model-fitting in the loop[C]//Proceedings of IEEE/CVF International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2019:2252-2261.
[15] KANAZAWA A, BLACK M J, JACOBS D W, et al.End-to-end recovery of human shape and pose[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:7122-7131.
[16] ZENG W, OUYANG W L, LUO P, et al.3D human mesh regression with dense correspondence[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2020:7052-7061.
[17] ZHENG Z D, YANG Y.Parameter-efficient person re-identification in the 3D space[EB/OL].[2021-10-05].https://arxiv.org/abs/2006.04569.
[18] ALLDIECK T, MAGNOR M, XU W P, et al.Video based reconstruction of 3D people models[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:8387-8397.
[19] ZHANG H, WU C R, ZHANG Z Y, et al.ResNeSt:split-attention networks[EB/OL].[2021-10-05].https://arxiv.org/pdf/2004.08955.pdf.
[20] HE K M, ZHANG X Y, REN S Q, et al.Deep residual learning for image recognition[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:770-778.
[21] ZHENG L, SHEN L Y, TIAN L, et al.Scalable person re-identification:a benchmark[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2015:1116-1124.
[22] GOU M R, KARANAM S, LIU W Q, et al.DukeMTMC4ReID:a large-scale multi-camera person re-identification dataset[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops.Washington D.C., USA:IEEE Press, 2017:1425-1434.
[23] WEI L H, ZHANG S L, GAO W, et al.Person transfer GAN to bridge domain gap for person re-identification[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:79-88.
[24] ZHOU J H, SU B, WU Y.Online joint multi-metric adaptation from frequent sharing-subset mining for person re-identification[C]//Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2020:2906-2915.
[25] ZHU Z H, JIANG X Y, ZHENG F, et al.Viewpoint-aware loss with angular regularization for person re-identification[J].Proceedings of the AAAI Conference on Artificial Intelligence, 2020, 34(7):13114-13121.
[26] WANG Y, SUN Y B, LIU Z W, et al.Dynamic graph CNN for learning on point clouds[J].ACM Transactions on Graphics, 2019, 38(5):146.
[27] CHARLES R Q, HAO S, MO K C, et al.PointNet:deep learning on point sets for 3D classification and segmentation[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2017:77-85.

选择文件类型/文献管理软件名称

选择包含的内容