摘要： 多通道界面旨在充分利用一个以上的感觉和动作通道来捕捉用户的意向,提高人机交互的自然性和高效性,其核心问题就是通道整合的问题。该文针对该问题提出了一个基于分层的任务模型的整合算法,该算法处理中涉及到程序运行状态表示、任务结构的设计和交互原语相关性表示等问题。针对以上3个问题展开讨论,在此基础上得到最后的算法。

关键词: 多通道用户界面, 有穷自动机, 对象属性结构, 交互原语

Abstract: The aim of multimodal interface is to get the users intent by more than one sense and action modals and to make the interaction of human an computer more natural and more effective. The key of multimodal interface is multimodal integration. In this article an integration algorithm based on task oriented and hierarchical multimodal integration modal is carried out. In this algorithm there are three questions: representation of programme state, desig of task structure and representation of the relativity of interaction primitive to be discussed. At last the algorithm is given.

中图分类号: 

• TP311.52