摘要： 提出一种基于交互语义的多通道分层整合方法，该方法结合概率以及时间约束等内容，从多通道的输入信息中捕获用户交互意图，形成交互任务。将其应用于虚拟环境中，根据实际需求设计并实现多种多通道交互技术，同时举例分析其整合过程。仿真实验结果表明，该方法是有效可行的。

关键词: 交互语义, 分层整合, 多通道交互, 上下文, 虚拟城市规划

Abstract: A hierarchical multimodal integration method based on Interaction Semantics(IS) is presented, which contains probability and time-constrain technology. The interaction intentions are distilled from multimodal inputs and a task is confirmed. The method is applied in virtual environment, and according to practical requirements, several kinds of multimodal interact technologies are designed and implemented. The integration process is tested by some cases. Simulation experimental results show this method is effective and feasible.

Key words: Interaction Semantics(IS), hierarchical integration, multimodal interaction, context, virtual city planning

中图分类号: 

• TP311.5