计算机工程

• 开发研究与工程应用 • 上一篇    下一篇

基于深度相机的自主虚拟化身情感交互技术

杨建辉,刘箴,陈浩   

  1. (宁波大学 信息科学与工程学院,浙江 宁波 315211)
  • 收稿日期:2015-08-01 出版日期:2016-06-15 发布日期:2016-06-15
  • 作者简介:杨建辉(1987-),男,硕士研究生,主研方向为虚拟现实、图形图像处理;刘箴,研究员;陈浩,硕士研究生。
  • 基金项目:
    国家自然科学基金资助项目(61373068);宁波市科技计划基金资助项目(2015A610128,2015C50053,2015D10011);宁波大学科研基金资助项目(XYW15010)。

Autonomous Virtual Avatar Emotional Interaction Technology Based on Depth Camera

YANG Jianhui,LIU Zhen,CHEN Hao   

  1. (Faculty of Electrical Engineering and Computer Science,Ningbo University,Ningbo,Zhejiang 315211,China)
  • Received:2015-08-01 Online:2016-06-15 Published:2016-06-15

摘要: 人机情感交互是虚拟现实的研究热点之一,深度相机的普及使基于深度相机的人机交互技术得到广泛应用。将微软Kinect2.0作为交互设备,定义不同情感语义的姿态和手势,设计基于模板匹配的手势识别方法。以建立人机情感和谐为设计目标,提出虚拟角色情感交互方法,构造虚拟化身的认知结构和情绪交互规则,并在计算机上实现原型系统。实验结果显示,虚拟化身可以通过表情动画和头部运动响应用户的身体动作,表明该技术方案具有可行性。

关键词: 虚拟化身, 情感交互, 人机交互, 眼动模型, 动态时间规整

Abstract: Human-computer emotion interaction is one of the research highlights in the virtual reality.The research of human-computer interaction based on depth camera is valuable with the popularity of depth camera.Using Microsoft Kinect2.0 as the interactive device,this paper defines different emotional semantic postures and gestures,and designs the gesture recognition method based on template matching.In order to realize the harmonious human-computer emotion,it proposes the method to realize emotional interaction of virtual characters and constructs cognitive structure and emotional interaction rules for the virtual avatar.The prototype system is realized in computer.Experimental result shows that the virtual avatar can respond to user’s body movement through facial animation and head motion.It proves that the proposed technical solution is feasible.

Key words: virtual avatar, emotional interaction, human-computer interaction, eye movement model, Dynamic Time Warping(DTW)

中图分类号: