Research on Emotion Extraction Approach Based on Action Recognition

doi:10.3969/j.issn.1000-3428.2015.05.056

Abstract

Abstract: Action recognition based on motion data is the frontier of computer vision and pattern recognition. However, combined with the results of action recognition,human sentiment extraction is relatively scarce. This paper explores and researches on this aspect. The research starts at the exploration of human emotion dataset. Combining computer graphics, artifical intelligence and machine learning,a standard human emotion dataset can be built. It contains four basic emotions: happiness,anger,sadness,fear,and two derived emotions:surprise and disgust. And it gets the relationship between action and emotion from the perspective of action. According to the divided reference of action recognition,the Period is regarded as the emotion extract unit,to ensure every Period’s emotion list. Combined with the rate,the emotion of the action can be extracted. Experimental results prove that emotion information can be extracted from 3D action data with the approach.

Key words: human behavior, action recognition, human modeling, emotion extraction, emotion model, emotion parameter

摘要： 基于运动数据的动作识别技术是当今计算机视觉和模式识别研究领域的热点问题,然而根据动作识别结果进行人体情绪提取的研究却较少。为此,在现有人体行为学研究的基础上,结合计算机图形学、人工智能和机器学习等技术,得出一套关于人体情绪的数据集合,包括开心、愤怒、悲伤、恐惧4 种基本情绪和惊喜、厌恶2 种衍生情绪。从动作的角度分析这6 种情绪得到动作,即情绪关系,按照动作识别的划分基准,将Period 作为情绪提取的最小单位,确定单个Period 的情绪列表,再结合动作和速率的参数,提取出在执行该动作时人体的情绪。实验结果表明,该方法能够有效地从3D 运动数据中提取情绪信息。

关键词: 人体行为学, 动作识别, 人体建模, 情绪提取, 情绪模型, 情绪参数

CLC Number:

TP18

LIU Yan,LIU Dingjia,HAN Zhipan. Research on Emotion Extraction Approach Based on Action Recognition[J]. Computer Engineering, doi: 10.3969/j.issn.1000-3428.2015.05.056.

刘艳,刘鼎家,韩智攀. 基于动作识别的情绪提取方法研究[J]. 计算机工程, doi: 10.3969/j.issn.1000-3428.2015.05.056.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.3969/j.issn.1000-3428.2015.05.056

http://www.ecice06.com/EN/Y2015/V41/I5/300

References

参考文献 [ 1 ]　Robertson N, Reid I. A General Method for Human Activity Recognition in Video[J]. Computer Vision and Image Understanding,2006,104(2):232-248. [ 2 ]　Bian Wei, Tao Dacheng, Rui Yong. Cross-domain Human Action Recognition [J]. IEEE Transactions on Systems,Man,and Cybernetics,2012,42(2):298-307. [ 3 ]　Wang Yang, Mori G. Hidden Part Models for Human Action Recognition:Probabilistic Versus Max Margin[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(7):1310-1323. [ 4 ]　Hakeem A, Shah M. Learning, Detection and Representation of Multi-agent Events in Videos [ J ]. Artificial Intelligence,2007,171(8):586-605. [ 5 ]　Hamano S, Takano W, Nakamura Y. Motion Data Retrieval Based on Statistic Correlation Between Motion Symbol Space and Language[C] / / Proceedings of IEEE International Conference on Intelligent Robots and Systems. Washington D. C. , USA: IEEE Press,2011: 3401-3406. [ 6 ]　Ren Cheng,Lei Xiaoyong,Zhang Guofeng. Motion Data Retrieval from Very Large Motion Databases [ C ] / / Proceedings of IEEE International Conference on Virtual Reality and Visualization. Washington D. C. , USA: IEEE Press,2011:70-77. [ 7 ]　Poppe R. A Survey on Vision-based Human Action Recognition [J]. Image and Vision Computing,2010, 28(6):976-990. [ 8 ]　Schuldt C, Laptev I, Caputo B. Recognizing Human Actions:A Local SVM Approach [C] / / Proceedings of the 17th International Conference on Pattern Recognition. Washington D. C. , USA: IEEE Press, 2004:32-36. [ 9 ]　Masoud O,Papanikolopoulos N. A Method for Human Action Recognition [J]. Image and Vision Computing, 2003,21(8):729-743. [10]　Rosales R. Recognition of Human Action Using Moment-based Feature, BU 98 - 020 [ R ]. Computer Science Department,Boston University,1998. [11]　Bobick A F, Davis J W. The Recognition of Human Movement Using Temporal Templates [ J ]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,23(3):257-267. [12]　Veeraraghavan A,Chellappa R,Roy-Chowdhury A K. The Function Space of an Activity[C] / / Proceedings of Computer Society Conference on Computer Vision and Pattern Recognition. Washington D. C. , USA: IEEE Press,2006:959-968. [13]　Velásquez J D. Modeling Emotions and Other Motivations in Synthetic Agents[C]/ / Proceedings of the 14th National Conference on Artificial Intelligence. New York, USA: ACM Press,1997:10-15. [14]　van de Stock J, Righart R, de Gelder B. Body Expressions Influence Recognition of Emotions in the Face and Voice[J]. Emotion,2007,7(3):487-494. [15]　Scherer K R, Ellgring H. Multimodal Expression of Emotion: Affect Programs or Componential Appraisal Patterns[J]. Emotion,2007,7(1):158-171. [16]　龚光红,冯　勤,彭晓源,等. 人体运动的形象化建模与仿真[J]. 系统仿真学报,2002,14(3):285-287. [17]　Gunes H, Piccardi M. Bi-modal Emotion Recognition from Expressive Face and Body Gestures[J]. Journal of Network and Computer Applications,2007,30(4):1334- 1345. [18]　Coulson M. Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence [ J ]. Journal of Nonverbal Behavior,2004,28(2):117-139. [19]　de Meijer M. The Contribution of General Features of Body Movement to the Attribution of Emotions [ J ]. Journal of Nonverbal Behavior,1989,13(4):247-268. 编辑　顾逸斐

[1]	MA Yatong, WANG Song, LIU Yingfang. Research on Human Action Recognition Method by Fusing Multimodal Data [J]. Computer Engineering, 2022, 48(9): 180-188.
[2]	SUN Qixiang, HE Ning, ZHANG Congcong, LIU Shengjie. Human Skeleton Action Recognition Method Based on Lightweight Graph Convolution [J]. Computer Engineering, 2022, 48(5): 306-313.
[3]	YAN Hang, CHEN Gang, TONG Yao, JI Bo, HU Beichen. Human Rehabilitation Action Recognition Based on Pose Estimation and GRU Network [J]. Computer Engineering, 2021, 47(1): 12-20.
[4]	LU Tianran,YU Fengqin,CHEN Ying. A Human Action Recognition Method Based on LSDA Dimension Reduction [J]. Computer Engineering, 2019, 45(3): 237-241,249.
[5]	CHEN Xiaochun, LIN Boyi, SUN Qian, ZHANG Kunhua. Action Recognition Based on Motion Region Difference and Convolutional Neural Network [J]. Computer Engineering, 2019, 45(12): 274-280,293.
[6]	ZHANG Rui,LI Qishen,CHU Jun. Human Action Recognition Algorithm Based on 3D Convolution Neural Network [J]. Computer Engineering, 2019, 45(1): 259-263.
[7]	LIU Yingying,QIU Song,SUN Li,ZHOU Mei,XU Wei. Human Action Recognition Method Based on Multi-view Self-paced Learning [J]. Computer Engineering, 2018, 44(2): 257-263.
[8]	LU Tianran,YU Fengqin,CHEN Ying. Human Action Recognition Algorithm with Temporal Rank Pooling of Valid Video Frames [J]. Computer Engineering, 2018, 44(12): 271-275,287.
[9]	CAO Jinqi,JIANG Xinghao,SUN Tanfeng. Video Human Action Recognition Algorithm Based on Trained Image CNN Features [J]. Computer Engineering, 2017, 43(11): 234-238.
[10]	CHENG Haisu,LI Qingwu,QIU Chunchun,GUO Jingjing. Human Action Recognition Algorithm Based on Improved Dense Trajectories [J]. Computer Engineering, 2016, 42(8): 199-205.
[11]	LUO Banghui,ZENG Jianping,DUAN Jiangjiao,WU Chengrong. Text Opinion Classification Method Based on Emotion Model [J]. Computer Engineering, 2015, 41(5): 175-179.
[12]	LIU Yujiao,FAN Yong,GAO Lin,YOU Xia. Human Action Recognition Algorithm Based on Spatial Temporal Depth Feature [J]. Computer Engineering, 2015, 41(5): 259-263.
[13]	LU Xian-ling, WANG Hong-bin, WANG Ying-ying, XU Xian. Application Research on Acceleration Data Features in Human Behavior Recognition [J]. Computer Engineering, 2014, 40(5): 178-182.
[14]	LIU Jie, LIU Zhen, HUANG Peng. An Emotion Model of Virtual Human Oriented to Trading Process [J]. Computer Engineering, 2013, 39(12): 277-279,284.
[15]	LIN Chun-Li, WANG Ke-Dun, WANG Ke-Cheng, JIA Tu- , CHENG Mo-Qing. Action Classification Algorithm Based on AEI and (2D)2PCA [J]. Computer Engineering, 2010, 36(24): 145-146.

Please choose a citation manager

Content to export