基于表观的归一化坐标系分类视线估计方法

doi:10.19678/j.issn.1000-3428.0059684

摘要/Abstract

摘要： 视线估计能够反映人的关注焦点，对理解人类的情感、兴趣等主观意识有重要作用。但目前用于视线估计的单目眼睛图像容易因头部姿态的变化而失真，导致视线估计的准确性下降。提出一种新型分类视线估计方法，利用三维人脸模型与单目相机的内在参数，通过人脸的眼睛与嘴巴中心的三维坐标形成头部姿态坐标系，从而合成相机坐标系与头部姿态坐标系，并建立归一化坐标系，实现相机坐标系的校正。复原并放大归一化得到的灰度眼部图像，建立基于表观的卷积神经网络模型分类方法以估计视线方向，并利用黄金分割法优化搜索，进一步降低误差。在MPIIGaze数据集上的实验结果表明，相比已公开的同类算法，该方法能降低约7.4%的平均角度误差。

关键词: 视线估计, 单目眼睛图像, 头部姿态, 归一化坐标系, 黄金分割法, 卷积神经网络

Abstract: Gaze estimation can naturally reflect people's focus of attention, and plays an important role in understanding human emotions, interests and other subjective consciousness.However, monocular images used for gaze estimation tend to be distorted due to head pose changes, which reduces the accuracy of gaze estimation.This paper proposes a new classification-based gaze estimation method.A three-dimensional face model and the inherent parameters of monocular camera are used to form a head pose coordinate system through the three-dimensional coordinates of the center of eye and mouth.The camera coordinate system and the head pose coordinate system are combined to establish a normalized coordinate system, and the camera coordinate system is corrected.The gray eye image is obtained by restoration, magnification and normalization.Finally a classification method using an appearance-based convolution neural network model is established to estimate gaze direction, and the golden section method is used to optimize the search process and further reduce errors.The experimental results show that compared with other similar methods, the proposed method can reduce the average angle errors by about 7.4% on the commonly used MPIIGaze test dataset.

Key words: gaze estimation, monocular eye image, head pose, normalized coordinate system, golden section method, Convolutional Neural Network(CNN)

中图分类号:

TP391

戴忠东, 任敏华. 基于表观的归一化坐标系分类视线估计方法[J]. 计算机工程, 2022, 48(2): 230-236.

DAI Zhongdong, REN Minhua. Gaze Estimation Method Using Normalized Coordinate System Classification Based on Apparent[J]. Computer Engineering, 2022, 48(2): 230-236.

http://www.ecice06.com/CN/Y2022/V48/I2/230

图/表 14

20220301181404

20220301181408

20220301181414

20220301181417

20220301181420

20220301181424

20220301181427

20220301181431

20220301181434

20220301181439

20220301181443

20220301181459

20220301181503

20220301181506

参考文献

[1] POWELL W A, CORBETT N, POWELL V.Computational linguistics:concepts, methodologies, tools, and applications[J].Express Shipping, 2020, 34(2):1459-1488.
[2] SUFI F B, GAZZANO J D D, CALLE F R, et al.Multi-camera tracking system applications based on reconfigurable devices:a review[C]//Proceedings of 2019 International Conference on Computer, Communication, Chemical, Materials and Electronic Engineering.Washington D.C., USA:IEEE Press, 2019:1-5.
[3] PARK S H, YOON H S, PARK K R.Faster R-CNN and geometric transformation-based detection of driver's eyes using multiple near-infrared camera sensors[J].Sensors, 2019, 19(1):197-205.
[4] SELIM M, FIRINTEPE A, PAGANI A, et al.Autopose:large-scale automotive driver head pose and gaze dataset with deep head orientation baseline[C]//Proceedings of the 15th International Conference on Computer Vision Theory and Applications.Washington D.C., USA:IEEE Press, 2020:599-606.
[5] LEE G J, JANG S W, KIM G Y.Pupil detection and gaze tracking using a deformable template[J].Multimedia Tools and Applications, 2020, 9(11):13-20.
[6] MAHMUD S, LIN X, KIM J H.Interface for human machine interaction for assistant devices:a review[C]//Proceedings of the 10th Annual Computing and Communication Workshop and Conference.Washington D.C., USA:IEEE Press, 2020:768-773.
[7] WANG Z, ZHAO J, LU C, et al.Learning to detect head movement in unconstrained remote gaze estimation in the wild[C]//Proceedings of IEEE Winter Conference on Applications of Computer Vision.Washington D.C., USA:IEEE Press, 2020:3443-3452.
[8] SUGANO Y, MATSUSHITA Y, SATO Y.Learning-by-synthesis for appearance-based 3D gaze estimation[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2014:1821-1828.
[9] BREIMAN L.Random forests, machine learning 45[J].Journal of Clinical Microbiology 2001, 2(30):199-228.
[10] COVER T.Estimation by the nearest neighbor rule[J].IEEE Transactions on Information Theory, 1968, 14(1):50-55.
[11] LU F, SUGANO Y, OKABE T, et al.Inferring human gaze from appearance via adaptive linear regression[C]//Proceedings of International Conference on Computer Vision.Washington D.C., USA:IEEE Press, 2011:153-160.
[12] ZHANG X, SUGANO Y, FRITZ M, et al.Appearance-based gaze estimation in the wild[C]//Proceedings of IEEE Conference on Computer Vision and Pattern recognition.Washington D.C., USA:IEEE Press, 2015:4511-4520.
[13] ZHANG X, SUGANO Y, FRITZ M, et al.Mpiigaze:real-world dataset and deep appearance-based gaze estimation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 41(1):162-175.
[14] RANJAN R, DE MELLO S, KAUTZ J.Light-weight head pose invariant gaze tracking[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops.Washington D.C., USA:IEEE Press, 2018:2156-2164.
[15] ZHANG X, SUGANO Y, FRITZ M, et al.It's written all over your face:full-face appearance-based gaze estimation[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D.C., USA:IEEE Press, 2017:51-60.
[16] LI M, CHEN R, LIAO X, et al.A precise indoor visual positioning approach using a built image feature database and single user image from smartphone cameras[J].Remote Sensing, 2020, 12(5):869-873.
[17] YIFAN X, JIANWEN L, JUNYU D, et al.Hybrid regression and isophote curvature for accurate eye center localization[J].Multimedia Tools and Applications, 2020, 79(2):805-824.
[18] SINGH A, HERUNDE H, FURTADO F.Modified haar-cascade model for face detection issues[J].International Journal of Research in Industrial Engineering, 2020, 38(12):145-1677.
[19] DHILLON A, VERMA G K.Convolutional neural network:a review of models, methodologies and applications to object detection[J].Progress in Artificial Intelligence, 2020, 9(2):85-112.
[20] BENDJILLALI R I, BELADGHAM M, MERIT K, et al.Illumination-robust face recognition based on deep convolutional neural networks architectures[J].Indonesian Journal of Electrical Engineering and Computer Science, 2020, 18(2):1015-1027.
[21] NANNI L, LUMINI A, GHIDONI S, et al.Stochastic selection of activation layers for convolutional neural networks[J].Sensors, 2020, 20(6):1626-1634.
[22] WANG S H, MUHAMMAD K, HONG J, et al.Alcoholism identification via convolutional neural network based on parametric ReLU, dropout, and batch normalization[J].Neural Computing and Applications, 2020, 32(3):665-680.
[23] LUO J, LIU J, LIN J, et al.A lightweight face detector by integrating the convolutional neural network with the image pyramid[J].Pattern Recognition Letters, 2020, 133(5):180-187.

选择文件类型/文献管理软件名称

选择包含的内容