基于改进特征金字塔网络的人体姿态估计

doi:10.19678/j.issn.1000-3428.0058544

计算机工程 ›› 2021, Vol. 47 ›› Issue (8): 251-259,270. doi: 10.19678/j.issn.1000-3428.0058544

基于改进特征金字塔网络的人体姿态估计

王柳程, 欧阳城添, 梁文

江西理工大学信息工程学院, 江西赣州 341000

收稿日期:2020-06-04 修回日期:2020-07-17 发布日期:2020-07-23
作者简介:王柳程(1995-),男,硕士,主研方向为人体姿态估计;欧阳城添,副教授、博士;梁文,硕士研究生。
基金资助:
江西省教育厅科学技术研究项目（GJJ170518）；江西省研究生创新专项资金（YC2018-S331）。

Human Pose Estimation Based on Improved Pyramid Feature Network

WANG Liucheng, OUYANG Chengtian, LIANG Wen

School of Information and Engineering, Jiangxi University of Science and Technology, Ganzhou, Jiangxi 341000, China

Received:2020-06-04 Revised:2020-07-17 Published:2020-07-23

摘要/Abstract

摘要： 为在人体姿态估计过程中有效获取多尺度特征和关键点坐标，建立一种基于改进特征金字塔网络（IPFN）的人体姿态跟踪模型。在原特征金字塔上采用新的检测器扩大感受野得到新特征金字塔，通过引入多尺度卷积生成高斯热点图，同时搜索和定位关键点，使坐标转换层将高斯热点图转为坐标，实现端到端训练过程。实验结果表明，相比FPN， IPFN模型在MPⅡ数据集的PCKh和COCO数据集的AP上分别提高了2.05和3.20个百分比；在踝、膝、腕和肘4个难检测部位上的PCKh分别提高了3.95、2.80、2.52和2.05个百分点。

关键词: 人体姿态估计, 特征金字塔, 坐标变换, 多尺度卷积, 高斯热点图

Abstract: To accurately acquire multi-scale features and keypoint coordinates in human pose estimation, a human pose tracking model based on Improved Pyramid Feature Network(IPFN) is established. On the basis of the original feature pyramid, a new detector is used to expand the receptive field for the new feature pyramid. Then gaussian heatmaps are generated by using multi-scale convolutions to search and locate the keypoints. The heatmaps are converted into coordinates by the coordinate transformation layer to realize end-to-end learning. Experimental results show that compared with traditional FPN, the IPFN model improves PCKh by 2.05 percentage point on the MPⅡ data set and AP by 3.2 percentage point on the COCO data set. The proposed model also improves PCKh by 3.95 percentage point for the ankle part, 2.80 percentage point for the knee part, 2.52 percentage point for the wrist part, and 2.05 percentage point for the elbow part.

Key words: human pose estimation, feature pyramid, coordinate transformation, multi-scale convolution, Gaussian heatmap

中图分类号:

TP391.41

王柳程, 欧阳城添, 梁文. 基于改进特征金字塔网络的人体姿态估计[J]. 计算机工程, 2021, 47(8): 251-259,270.

WANG Liucheng, OUYANG Chengtian, LIANG Wen. Human Pose Estimation Based on Improved Pyramid Feature Network[J]. Computer Engineering, 2021, 47(8): 251-259,270.

https://www.ecice06.com/CN/Y2021/V47/I8/251

图/表 13

20210819202033

20210819202038

20210819202042

20210819202047

20210819202051

20210819202055

20210819202105

20210819202110

20210819202114

20210819202120

20210819202125

20210819202129

20210819202134

参考文献

[1] FISCHLER M A, ELSCHLAGER R A.The representation and matching of pictorial structures[J]. IEEE Transactions on Computer, 1973, 22(1): 67-92.
[2] FELZENSZWALB P F, HUTTENLOCHER D P.Pictorial structures for object recognition[J]. International Journal of Computer Vision, 2005, 61(1): 55-79.
[3] DALAL N, TRIGGS B.Histograms of oriented gradients for human detection[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2005:886-893.
[4] TOSHEV A, SZEGEDY C.DeepPose:human pose estimation via deep neural networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2014:1653-1660.
[5] LIN T Y, DOLLAR P, GIRSHICK R, et al. Feature pyramid networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2017:2117-2125.
[6] CHEN Y L, WANG Z C, PENG Y X, et al. Cascaded pyramid network for multi-person pose estimation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2018:7103-7112.
[7] XIAO B, WU H P, WEI Y C.Simple baselines for human pose estimation and tracking[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2018:472-487.
[8] SUN X, XIAO B, WEI F Y, et al. Integral human pose regression[C]//Proceedings of European Conference on Computer Vision.Berlin, Germany:Springer, 2018:536-553.
[9] LUVIZON D C, TABIA H, PICARD D.Human pose regression by combining indirect part detection and contextual information[J]. Computers and Graphics, 2019, 85:15-22.
[10] 林志洁, 罗壮, 赵磊, 等. 特征金字塔多尺度全卷积目标检测算法[J]. 浙江大学学报, 2019, 53(3): 533-540. LUO Z H, LUO Z, ZHAO L, et al. Multi-scale convolution target detection algorithm with feature pyramid[J]. Journal of Zhejiang University, 2019, 53(3): 533-540.(in Chinese)
[11] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2016:770-778.
[12] NIBALI A, HE Z, MORGAN S, et al. Numerical coordinate regression with convolutional neural networks[EB/OL]. [2020-06-12]. http://export.arxiv.org/abs/1801.07372.
[13] JADERBERG M, SIMONYAN K, ZISSERMAN A, et al. Spatial transformer networks[C]//Proceedings of Advances in Neural Information Processing Systems.Cambridge, USA:MIT Press, 2015:2017-2025.
[14] CAO Z, SIMON T, WEI S-E, et al. Realtime multi-person 2D pose estimation using part affinity fields[C]//Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. Washington D. C., USA:IEEE Press, 2017:1302-1310.
[15] FANG H, XIE S, TAI S, et al. RMPE:regional multi-person pose estimation[C]//Proceedings of IEEE International Conference on Computer Vision. Washington D. C., USA:IEEE Press, 2017:2353-2362.
[16] LIFSHITZ I, FETAYA E, ULLMAN S. Human pose estimation using deep consensus voting[C]//Proceedings of European Conference on Computer Vision. Berlin, Germany:Springer, 2016:246-260.
[17] GKIOXARI G, TOSHEV A, JAITLY N. Chained predictions using convolutional neural networks[C]//Proceedings of European Conference on Computer Vision. Berlin, Germany:Springer, 2016:728-743.
[18] NEWELL A, YANG K, DENG J. Stacked hourglass networks for human pose estimation[C]//Proceedings of European Conference on Computer Vision. Berlin, Germany:Springer, 2016:483-499.
[19] KOCABAS M, KARAGOZ S, AKBAS E.. Multiposenet:fast multi-person pose estimation using pose residual network[C]//Proceedings of the European Conference on Computer Vision. Berlin, Germany:Springer, 2018:417-433.
[20] NEWELL A, HUANG A, DENG J. Associative embedding:end-to-end learning for joint detection and grouping[C]//Proceedings of Advances in Neural Information Processing Systems. Cambridge, USA:MIT Press, 2017:2277-2287.
[21] PAPANDREOU G, ZHU T, CHEN L C, et al. Personlab:person pose estimation and instance segmentation with a bottom-up, part-based, geometric embedding model[C]//Proceedings of the European Conference on Computer Vision. Berlin, Germany:Springer, 2018:269-286.

选择文件类型/文献管理软件名称

选择包含的内容

基于改进特征金字塔网络的人体姿态估计

Human Pose Estimation Based on Improved Pyramid Feature Network

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 13

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

[1]	徐芳芯, 樊嵘, 马小陆. 面向拥挤行人检测的改进YOLOv7算法[J]. 计算机工程, 2024, 50(3): 250-258.
[2]	赵佳圆, 张玉茹, 苏晓东, 徐红岩, 李世洲, 张玉荣. 基于注意力机制的人体关键点隐式建模网络[J]. 计算机工程, 2024, 50(3): 317-325.
[3]	圣文顺, 余熊峰, 林佳燕, 陈欣. 融合注意力与特征金字塔的小尺度目标检测算法[J]. 计算机工程, 2024, 50(1): 242-250.
[4]	李现国, 李滨. 基于Transformer和多尺度CNN的图像去模糊[J]. 计算机工程, 2023, 49(9): 226-233, 245.
[5]	龙玉江, 卫薇, 舒彧, 张正刚, 王道累, 李峰. 基于自适应关键点的破损旋转绝缘子检测方法[J]. 计算机工程, 2023, 49(9): 272-278.
[6]	刘豪, 吴红兰, 房宇轩. 结合全局上下文信息的高效人体姿态估计[J]. 计算机工程, 2023, 49(7): 102-109.
[7]	王款, 宣士斌, 何雪东, 李紫薇, 李嘉祥. 基于交叉注意力Transformer的人体姿态估计方法[J]. 计算机工程, 2023, 49(7): 223-231.
[8]	焦义, 徐华兴, 毛晓波, 李楠, 姚国梁, 倪金红, 徐向阳. 融合多尺度特征的脑电情感识别研究[J]. 计算机工程, 2023, 49(5): 81-89,96.
[9]	钟宝荣, 吴夏灵. 基于高分辨率网络的轻量型人体姿态估计研究[J]. 计算机工程, 2023, 49(4): 226-232,239.
[10]	马素刚, 陈期梅, 侯志强, 杨小宝, 张子贤. 基于密集连接与特征增强的语义分割算法[J]. 计算机工程, 2023, 49(3): 263-270.
[11]	王程, 刘元盛, 刘圣杰. 基于改进YOLOv4的小目标行人检测算法[J]. 计算机工程, 2023, 49(2): 296-302,313.
[12]	胡清翔, 饶文碧, 熊盛武. 面向无人机遥感场景的轻量级小目标检测算法[J]. 计算机工程, 2023, 49(12): 169-177.
[13]	王楷, 韩笑, 朱华吉, 缪祎晟, 吴华瑞. 基于YOLACT-RFX模型的穴盘甘蓝苗株分割算法[J]. 计算机工程, 2023, 49(12): 214-223.
[14]	吴奇林, 党亚固, 熊山威, 吉旭, 毕可鑫. 基于混合特征网络的学生评教文本情感分析模型[J]. 计算机工程, 2023, 49(11): 24-29, 39.
[15]	贵向泉, 张馨月, 李立. 高分辨率皮肤黑色素瘤图像的两阶段式分割算法[J]. 计算机工程, 2023, 49(11): 267-274.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于改进特征金字塔网络的人体姿态估计

Human Pose Estimation Based on Improved Pyramid Feature Network

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 13

参考文献

相关文章 15

编辑推荐

Metrics

本文评价