摘要： 头戴式增强/混合现实设备虚实融合存在内容独占、不易分享等局限，在多人协同作业时，仅使用者能够获取虚实融合场景，其他人无法沉浸式介入内容，从而限制了相关设备的应用范围。为此，提出基于网络通信的低延迟虚实融合内容第三方视角可视化方法。通过计算捕捉空间方位反推虚实融合空间第三方视角方位，完成主视角与第三方视角空间匹配，根据多终端之间的数据通信要求，结合多视角的交互信息/环境信息/虚实状态的多种数据类型特点，提出多种信息同步策略，确保不同场景下内容的准确同步。实验结果表明，该方法可有效实现穿戴式增强/混合现实设备多人实时协同操作，具有稳定、高效的应用效果。

关键词: 增强/混合现实, 主视角, 第三方视角, 信息同步策略, 锚点

Abstract: The real and virtual environment fusion technology used in head-mounted Augmented/Mixed Reality(AR/MR) devices has some limitations, such as content exclusivity and difficulty in sharing.That means when multiple people work together, only the user of the device can obtain the scene of the fused real and virtual environment, and other people cannot immerse themselves in the content, so the application of the devices is limited.To address the above problems, this paper proposes a low-delay method based on network communication for virtualizing the fused real and virtual environment from the third-party perspective.The method calculates the captured spatial orientation, and on this basis infers the orientation of the third-party perspective of the fused real and virtual space, completing the spatial matching between the main perspective and the third-party perspective.According to the data communication requirements between multiple terminals, and the features of the multiple data types of interaction information/environment information/real and virtual fusion information under multiple perspectives, this paper also proposes a synchronization strategy for different types of information to ensure the content information in different scenarios to be synchronized accurately.The experimental results show that the proposed method enables multiple people to collaborate in real time on head-mounted AR/MR devices, and has stable and efficient application performance.

Key words: Augmented/Mixed Reality(AR/MR), main perspective, third-party perspective, information synchronization strategy, anchor point

中图分类号: 

• TP391