基于Spark平台的人脸图像检索系统

计算机工程

基于Spark平台的人脸图像检索系统

陈新荃^1,2,陈晓东¹,蒋林华³

(1.中国科学院上海高等研究院,上海 201210; 2.中国科学院大学,北京 100049; 3.上海理工大学,上海 200093)

收稿日期:2016-12-28 出版日期:2018-02-15 发布日期:2018-02-25
作者简介:陈新荃(1991—),男,硕士研究生,主研方向为人脸识别、图像检索;陈晓东,研究员;蒋林华,教授。

Face Image Retrieval System Based on Spark Platform

CHEN Xinquan ^1,2,CHEN Xiaodong ¹,JIANG Linhua ³

(1.Shanghai Advanced Research Institute,Chinese Academy of Sciences,Shanghai 201210,China;2.University of Chinese Academy of Sciences,Beijing 100049,China;3.University of Shanghai for Science and Technology,Shanghai 200093,China)

Received:2016-12-28 Online:2018-02-15 Published:2018-02-25

摘要/Abstract

摘要： 传统人脸图像检索技术处理大规模图像数据时检索效率较低。为此,基于视觉词袋模型与Spark分布式计算平台构建人脸图像检索系统。根据人脸图像空间分布特点提出局部区块划分方法,减少视觉特征数并提高流程并行度,同时结合SURF局部特征和HOG区块特征设计候选图像相似得分算法,提高检索准确率。实验结果表明,与基于Hadoop的检索系统相比,该系统索引构建和检索的效率较高,并且在海量图像数据场景下具有良好的可扩展性和并发性。

关键词: 人脸图像检索, 分布式计算, 区块匹配, 相似度, 视觉词袋模型

Abstract: Traditional face image retrieval technology has lower retrieval efficiency when processing large-scale image data.Aiming at this problem,a face retrieval system based on Bag-of-Visual-Words(BoVW) model and Spark distributed platform is constructed in this paper.A local block partition method is proposed according to the spatial distribution of a face image,so as to reduce the number of visual features and enhance parallelism.By combining the Speed-up Robust Feature(SURF) local features and Histogram of Oriented Gradient(HOG) block features,a similarity algorithm of candidate images is designed to improve the retrieval accuracy.Experimental results show that the efficiency of the index construction and image retrieval in the proposed system are higher than those of the retrieval system based on Hadoop.The proposed system also has good scalability and concurrency under the massive image data scene.

Key words: face image retrieval, distributed computing, block matching, similarity, Bag-of-Visual-Word(BoVW) model

中图分类号:

TP391

陈新荃,陈晓东,蒋林华. 基于Spark平台的人脸图像检索系统[J]. 计算机工程.

CHEN Xinquan,CHEN Xiaodong,JIANG Linhua. Face Image Retrieval System Based on Spark Platform[J]. Computer Engineering.

参考文献

参考文献［1］赵永威,李弼程,彭天强,等.一种基于随机化视觉词典组和查询扩展的目标检索方法［J］.电子与信息学报,2012,34(5):1154-1161. ［2］Apache SparkTM-Lightning-fast Cluster Computing［EB/OL］.［2016-12-16］.http://spark.apache.org/. ［3］DEAN J,GHEMAWAT S.MapReduce:Simplified Data Processing on Large Clusters［J］.Communications of the ACM,2008,51(1):107-113. ［4］SHVACHKO K,KUANG H,RADIA S,et al.The Hadoop Distributed File System［C］//Proceedings of the 26th Symposium on Mass Storage Systems and Technologies.Washington D.C.,USA:IEEE Press,2010:1-10. ［5］KAMENCAY P,BREZNAN M,JELSOVKA D,et al.Improved Face Recognition Method Based on Segmentation Algorithm Using SIFT-PCA［C］//Proceedings of the 35th International Conference on Telecommunications and Signal Processing.Washington D.C.,USA:IEEE Press,2012:758-762. ［6］PARUA S,DAS A,MAZUMDAR D,et al.Deter-mination of Feature Hierarchy from Gabor and SIFT Features for Face Recognition［C］//Proceedings of the 2nd International Conference on Emerging Applications of Information Technology.Washington D.C.,USA:IEEE Press,2011:257-260. ［7］彭天强,栗芳.基于二进制哈希与空间金字塔的视觉词袋模型生成方法［J］.计算机工程,2016,42(12):164-170. ［8］dos SANTOS J M,de MOURA E S,da SILVA A S,et al.A Signature-based Bag of Visual Words Method for Image Indexing and Search［J］.Pattern Recognition Letters,2015,65(C):1-7. ［9］LU Guoyu,HU Yingjie,SEBE N.Weighted SIFT Feature Learning with Hamming Distance for Face Recognition［C］//Proceedings of 2014 International Conference on Computer Vision Theory and Applications.Washington D.C.,USA:IEEE Press,2014:691-699. ［10］CHEN B C,CHEN Y Y,KUO Y H,et al.Scalable Face Image Retrieval Using Attribute-enhanced Sparse Code-words［J］.IEEE Transactions on Multimedia,2013,15(5):1163-1173. ［11］WANG Hanli,XIAO Bo,WANG Lei,et al.CHCF:A Cloud-based Heterogeneous Computing Framework for Large-scale Image Retrieval［J］.IEEE Transactions on Circuits and Systems for Video Technology,2015,25(12):1900-1913. ［12］朱为盛,王鹏.基于 Hadoop 云计算平台的大规模图像检索方案［J］.计算机应用,2014,34(3):695-699. ［13］GRACE R K,MANIMEGALAI R,KUMAR S S.Medical Image Retrieval System in Grid Using Hadoop Framework［C］//Proceedings of 2014 International Conference on Computational Science and Computa-tional Intelligence.Washington D.C.,USA:IEEE Press,2014:144-148. ［14］RAJU U S N,GEORGE S,PRANEETH V S,et al.Content Based Image Retrieval on Hadoop Framework［C］//Proceedings of 2015 IEEE International Congress on Big Data.Washington D.C.,USA:IEEE Press,2015:661-664. ［15］CHENG Wenchen,QIAN Jiang,ZHAO Zhicheng,et al.Large Scale Cross-media Data Retrieval Based on Hadoop［C］//Proceedings of the 11th International Con-ference on Heterogeneous Networking for Quality,Reliabi-lity,Security and Robustness.Washington D.C.,USA:IEEE Press,2015:133-138. ［16］BRADSKI G.The Opencv Library［J］.Dr. Dobb’s Journal,2000,25(11):120-126. ［17］Apache HBaseTM［EB/OL］.［2016-12-16］.http://hbase.apache.org/. ［18］LIENHART R,MAYDT J.An Extended Set of Haar-like Features for Rapid Object Detection［C］//Proceedings of 2002 International Conference on Image Processing.Washington D.C.,USA:IEEE Press,2002:900-903. ［19］BAY H,TUYTELAARS T,van GOOL L.Surf:Speeded up Robust Features［C］//Proceedings of European Con-ference on Computer Vision.Berlin,Germany:Springer,2006:404-417. ［20］DREUW P,STEINGRUBE P,HANSELMANN H,et al.SURF-Face:Face Recognition Under Viewpoint Con-sistency Constraints［C］//Proceedings of British Machine Vision Conference.London,UK:［s.n.］,2009:1-11. ［21］DALAL N,TRIGGS B.Histograms of Oriented Gradients for Human Detection［C］//Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington D.C.,USA:IEEE Press,2005:886-893. ［22］CHOI E,LEE C.Feature Extraction Based on the Bhattacharyya Distance［J］.Pattern Recognition,2003,36(8):1703-1709. ［23］HUANG G B,RAMESH M,BERG T,et al.Labeled Faces in the Wild:A Database for Studying Face Recognition in Unconstrained Environments:07-49［R］.Amherst,USA:University of Massachusetts,Amherst,2007. 编辑金胡考

[1]	林加艺, 夏鸿斌, 刘渊. 基于类比学习的数学应用题求解模型[J]. 计算机工程, 2024, 50(7): 63-70.
[2]	耿丽丽, 牛保宁. 基于通道相似度熵的卷积神经网络裁剪[J]. 计算机工程, 2024, 50(7): 133-143.
[3]	李雪, 王雅文, 张前进. 基于信息检索的源代码自动命名[J]. 计算机工程, 2024, 50(6): 304-310.
[4]	邓远飞, 李加伟, 蒋运承. 基于知识注入提示学习的专利短语相似度计算[J]. 计算机工程, 2024, 50(4): 294-302.
[5]	史艳琼, 查昭, 张文亮, 戴尔愉, 陈中. 基于深度估计置信度的聚焦形貌恢复[J]. 计算机工程, 2024, 50(3): 233-241.
[6]	程小辉, 李钰, 康燕萍. 基于中间图特征提取的卷积网络双标准剪枝[J]. 计算机工程, 2023, 49(3): 105-112.
[7]	胡慧旗, 张维强, 徐晨. 判别性增强的稀疏子空间聚类[J]. 计算机工程, 2023, 49(2): 98-104.
[8]	杨振宇, 王磊, 马博, 杨雅婷, 董瑞, 艾孜麦提·艾瓦尼尔, 王震. 一种针对维汉的跨语言远程监督方法[J]. 计算机工程, 2023, 49(2): 271-278.
[9]	刘栋, 杨辉, 姬少培, 曹扬. 基于多模型加权组合的文本相似度计算模型[J]. 计算机工程, 2023, 49(10): 97-104.
[10]	潘金凤, 尹丽菊, 高明亮, 邹国峰. 压缩感知观测信号的低秩稀疏分解[J]. 计算机工程, 2022, 48(8): 234-239.
[11]	周瑞朋, 秦进. 基于最佳子策略记忆的强化探索策略[J]. 计算机工程, 2022, 48(2): 106-112.
[12]	王治和, 曹旭琰, 杜辉. 一种优化初始点与自适应半径的密度聚类算法[J]. 计算机工程, 2022, 48(1): 51-59.
[13]	张基, 谢在鹏, 毛莺池, 徐媛媛, 朱晓瑞, 李博文. MapReduce框架下结合分布式编码计算的容错算法[J]. 计算机工程, 2021, 47(4): 173-179.
[14]	石彩霞, 李书琴, 刘斌. 多重检验加权融合的短文本相似度计算方法[J]. 计算机工程, 2021, 47(2): 95-102.
[15]	田智慧, 马占宇, 魏海涛. 基于密度核心的出租车载客轨迹聚类算法[J]. 计算机工程, 2021, 47(2): 133-138.

选择文件类型/文献管理软件名称

选择包含的内容