Augmented Reality Method Based on KCF and Improved ORB

doi:10.19678/j.issn.1000-3428.0053924

Abstract

Abstract: Aiming at the situation that the area to be resigistered in the Augmented Reality(AR) system is occluded when the virtual information is superimposed,a three-dimensional registration method for AR system based on real-time feature detection and target tracking is proposed.KCF algorithm is used to perform real-time FAST feature matching on the target area and the template.By improving the ORB algorithm,SIFT-ORB-MRANSAC fusion algorithm is proposed to extract and match feature remove mismatches.On this basis,the registration matrix is calculated by the matching relationship between the feature points,and virtual information is overlaid to the registration matrix to augment the real world.Experimental results show that the proposed method can quickly and accurately overlay the virtual information to the registered area under the conditions of illumination change,occlusion and rotation transformation,and improve the points as well as computation efficiency of AR systems.

Key words: ORB algorithm, KCF algorithm, Augmented Reality(AR), three-dimensional registration, feature point

摘要： 针对增强现实（AR）系统在进行虚拟信息叠加时待注册区域被遮挡的情况，提出一种基于实时特征检测与目标跟踪的AR系统三维注册方法。使用KCF算法对待注册目标区域与模板进行实时FAST特征匹配，通过改进ORB算法，提出SIFT-ORB-MRANSAC融合算法，完成特征点的提取、匹配以及误匹配去除。在此基础上，根据特征点之间的匹配关系计算注册矩阵，通过注册矩阵叠加虚拟信息实现对现实世界的增强。实验结果表明，该方法在光照变化、遮挡以及旋转变换的情况下，可将虚拟信息快速、准确地叠加到待注册区域，提高AR系统的运算效率。

关键词: ORB算法, KCF算法, 增强现实, 三维注册, 特征点

CLC Number:

TP391.9

LI Yi, FENG Nan, TAN Shuncheng. Augmented Reality Method Based on KCF and Improved ORB[J]. Computer Engineering, 2019, 45(8): 230-235.

李一, 冯楠, 谭顺成. 基于KCF与改进ORB的增强现实方法[J]. 计算机工程, 2019, 45(8): 230-235.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0053924

http://www.ecice06.com/EN/Y2019/V45/I8/230

References 28

[1]	BILLINGHURST M,CLARK A,LEE G.A survey of augmented reality[J].Foundations and Trends in Human-Computer Interaction,2015,8(2/3):73-272.
[2]	王月,张树生,何卫平,等.基于模型的增强现实无标识三维注册追踪方法[J].上海交通大学学报,2018,52(1):83-89.
[3]	李乾,高尚兵,潘志庚,等.基于无标记识别的增强现实方法研究[J].系统仿真学报,2018,30(7):191-197.
[4]	LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[5]	欧阳能钧,李伟彤,韦蔚,等.基于SIFT与Contourlee变换分辨遥感图像配准[J].遥感技术与应用,2013,28(1):58-64.
[6]	BAY H,WALKER J J,HARRIS J K.et al.Error-correcting barcoded primers for pyrosequencing hundreds of samples in multiplex[J].Nature Methods,2008,5(3):235-237.
[7]	RUBLEE E,RABAUD V,KONOLIGE K,et al.ORB:an efficient alternative to SIFT or SURF[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2012:2564-2571.
[8]	WU Yi,LIM J,YANG M H.Online object tracking:a benchmark[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2013:2411-2418.
[9]	KALAL Z,MIKOLAJCZYK K,MATAS J.Tracking-learning-detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(7):1409-1422.
[10]	HARE S,SAFFARI A,TORR P H S.Struck:structured output tracking with kernels[C]//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2011:263-270.
[11]	ZHANG Kaihua,ZHANG Lei,YANG M H.Real-time compressive tracking[C]//Proceedings of European Conference on Computer Vision.Washington D.C.,USA:IEEE Press,2012:864-877.
[12]	李炎,尹东.基于TLD的增强现实跟踪注册方法[J].系统仿真学报,2014,26(9):2062-2067.
[13]	钟权,周进,吴钦章,等.一种改进的实时压缩跟踪算法[J].光电工程,2014,41(4):1-8.
[14]	荆圣媛,韩勇,孟学文,等.移动AR+VR支持下旅游GIS系统的设计与实现[J].测绘通报,2019(1):79-84.
[15]	HENRIQUES J F,CASEIRO R,PEDRO M,et al.High-speed tracking with kernelized correlation filters[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(3):583-596.
[16]	王任华,沈剑宇,蒋敏.基于自适应多模型联合的目标跟踪算法[J/OL].计算机工程:1-9[2019-06-21].https://doi.org/10.19678/j.issn.1000-3428.0052593.
[17]	RABIN J,DELON J,GOUSSEAU Y,et al.MAC-RANSAC:a robust algorithm for the recognition of multiple objects[C]//Proceedings of the 5th International Symposium on 3D Data Processing,Visualization and Transmission.Paris,France:[s.n.],2010:51.
[18]	ROSTEN E,DRUMMOND T.Machine learning for highspeed corner detection[C]//Proceedings of European Conference on Computer Vision.Graz,Austria:[s.n.],2006:430-443.
[19]	CALONDER M,LEPETIT V,STRECHA C,et al.Brief:binary robust ipendent elementary features[C]//Proceedings of European Conference on Computer Vision.Heraklion,Greece:[s.n.],2010:778-792.
[20]	ROSIN P L.Measuring corner properties[J].Computer Vision and Image Understanding,1999,73(2):291-307.
[21]	周见光,石刚,马小虎.增强现实系统中的虚拟交互方法[J].计算机工程,2012,38(1):251-252.
[22]	施琦,王涌天,陈靖.一种基于视觉的增强现实三维注册算法[J].中国图象图形学报,2018,7(7):679-683.
[23]	顾庆传,姜娜.基于FAST特征点检测的实时虚实注册方法[J].哈尔滨师范大学自然科学学报,2017,33(2):58-62.
[24]	张亚玲,朱望纯.基于物体识别的增强现实装配指导[J].桂林电子科技大学学报,2018,38(5):29-32.
[25]	谭暑秋.面部动态增强现实的特征点检测方法研究[D].杭州:电子科技大学,2018.
[26]	张浩华,吴艳敏,程立英,等.基于移动端平台古生物博物馆增强现实系统的设计与应用[J].沈阳师范大学学报(自然科学版),2018,36(2):61-69.
[27]	王小红.基于TLD与SIFT的增强现实三维注册方法[J].哈尔滨师范大学自然科学学报,2017,33(2):71-74.
[28]	邢藏菊,温兰兰,何苏勤.TLD视频目标跟踪器快速匹配的研究[J].小型微型计算机系统,2015,36(5):1113-1116.

Please choose a citation manager

Content to export