基于蜕变测试的面向用户搜索引擎性能分析

doi:10.19678/j.issn.1000-3428.0053243

计算机工程 ›› 2019, Vol. 45 ›› Issue (10): 52-56,63. doi: 10.19678/j.issn.1000-3428.0053243

基于蜕变测试的面向用户搜索引擎性能分析

杨正龙, 高建华

上海师范大学计算机科学与技术系, 上海 200234

收稿日期:2018-11-26 修回日期:2019-01-06 出版日期:2019-10-15 发布日期:2019-01-24
作者简介:杨正龙(1995-),男,硕士研究生,主研方向为软件测试;高建华,教授、博士。
基金资助:
国家自然科学基金（61672355）。

User-oriented Performance Analysis of Search Engine Based on Metamorphic Test

YANG Zhenglong, GAO Jianhua

Department of Computer Science and Technology, Shanghai Normal University, Shanghai 200234, China

Received:2018-11-26 Revised:2019-01-06 Online:2019-10-15 Published:2019-01-24

摘要/Abstract

摘要： 面对海量的互联网信息，用户在进行搜索时缺乏客观公认的Oracle验证搜索引擎所返回结果是否正确。为此，将蜕变测试应用于搜索引擎的性能测试。针对搜索引擎Baidu、Bing和360，结合搜索操作符定义相应的蜕变关系，对其检索能力和排序稳定性进行测试，并通过异常率和平均Jaccard系数量化测试结果。分析结果表明，在搜索引擎Baidu、Bing和360中，Bing的异常率最低，Baidu的排序稳定性最高，三者对于不同领域的关键词搜索表现相差不大，但对于不同语言搜索表现存在很大差别。该结果为不同领域用户在选择合适的搜索引擎时提供了参考，同时可帮助搜索引擎的开发人员发现和移除程序中的错误。

关键词: 搜索引擎, 蜕变测试, 蜕变关系, Oracle问题, 异常率, Jaccard系数

Abstract: Facing a large amount of Internet information,users lack an objective recognized Oracle to verify whether the results returned by the search engine are correct or not.Therefore,the metamorphic test is applied for search engine performance test.For search engines like Baidu,Bing and 360,the corresponding metamorphic relationship is defined by combining search operators.Their retrieval ability and sorting stability are tested,and the test results are quantified by abnormal rate and average Jaccard coefficient.Analysis results show that,among search engines Baidu,Bing and 360,Bing has the lowest abnormal rate and Baidu has the highest ranking stability.Meanwhile,Baidu,Bing and 360 have little difference in keyword search performance in different fields,but there are big differences in search performance of different languages.The results provide a reference for users of different domain when choosing the right search engine,and help search engine developers to find and remove errors in the program.

Key words: search engine, metamorphic test, metamorphic relation, Oracle problem, abnormal rate, Jaccard coefficient

中图分类号:

TP311

杨正龙, 高建华. 基于蜕变测试的面向用户搜索引擎性能分析[J]. 计算机工程, 2019, 45(10): 52-56,63.

YANG Zhenglong, GAO Jianhua. User-oriented Performance Analysis of Search Engine Based on Metamorphic Test[J]. Computer Engineering, 2019, 45(10): 52-56,63.

https://www.ecice06.com/CN/Y2019/V45/I10/52

图/表 8

20191014193039

20191014193042

20191014193045

20191014193048

20191014193051

20191014193054

20191014193057

20191014193100

参考文献 21

[1]	王蓁蓁,软件测试理论初步框架[J].计算机科学,2014,41(3):12-16.
[2]	CHEN T Y,CHEUNG S C,YIU S M.Metamorphic testing:a new approach for generating next test cases,HKUSTCS98-01[R].Hong Kong,China:Hong Kong University of Science and Technology,1998.
[3]	TAO Qiuming,WU Wei,ZHAO Chen,et al.An automatic testing approach for compiler based on metamorphic testing technique[C]//Proceedings of the 17th Asia Pacific Software Engineering Conference.Sydney,Australia:[s.n.],2010:270-279.
[4]	LE V,AFSHARI M,SU Zhendong.Compiler validation via equivalence modulo inputs[C]//Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation.New York,USA:ACM Press,2014:216-226.
[5]	MURPHY C,RAUNAK M S,KING A,et al.On effective testing of health care simulation software[C]//Proceedings of the 3rd ACM Workshop on Software Engineering in Health Care.New York,USA:ACM Press,2011:40-47.
[6]	JIANG Mingyue,CHEN T Y,KUO F C,et al.Testing central processing unit scheduling algorithms using metamorphic testing[C]//Proceedings of the 4th IEEE International Conference on Software Engineering and Service Science.Washington D.C.,USA:IEEE Press,2013:530-536.
[7]	KUO F C,CHEN T Y,TAM W K.Testing embedded software by metamorphic testing:a wireless metering system case study[C]//Proceedings of IEEE International Conference on Local Computer Networks.Washington D.C.,USA:IEEE Press,2011:291-294.
[8]	PULLUM L L,OZMEN O.Early results from metamorphic testing of epidemiological models[C]//Proceedings of IEEE International Conference on BioMedical Computing.Washington D.C.,USA:IEEE Press,2012:62-67.
[9]	SEGURA S,HIERONS R M,BENAVIDES D,et al.Automated test data generation on the analyses of feature models:a metamorphic testing approach[C]//Proceedings of International Conference on Software Testing,Verification and Validation.Paris,France:[s.n.],2010:35-44.
[10]	SEGURA S,HIERONS R M,BENAVIDES D,et al.Automated metamorphic testing on the analyses of feature models[J].Information and Software Technology,2011,53(3):245-258.
[11]	ZHOU Zhiquan,TSE T H,KUO F C,et al.Automated functional testing of Web search engines in the absence of an Oracle,TR-2007-06[R].Hong Kong,China:Hong Kong University of Science and Technology,2007.
[12]	ZHOU Zhiquan,XIANG Shaowen,CHEN T Y.Metamorphic testing for software quality assessment:a study of search engines[J].IEEE Transactions on Software Engineering,2016,42(3):264-284.
[13]	ARUNA C,PRASAD R S R.Metamorphic relations to improve the test accuracy of multi precision arithmetic software applications[C]//Proceedings of International Conference on Advances in Computing,Communications and Informatics.New Delhi,India:[s.n.],2014:2244-2248.
[14]	CASTRO-CABRERA C,MEDINA-BULO I.Application of metamorphic testing to a case study in Web services compositions[C]//Proceedings of ICETE’12.Rome,Italy:[s.n.],2012:168-181.
[15]	DING Junhua,WU Tong,WU Dianxiang,et al.Metamorphic testing of a Monte Carlo modeling program[C]//Proceedings of the 6th International Workshop on Automation of Software Test.Honolulu,USA:[s.n.],2011:1-7.
[16]	印鉴,陈忆群,张钢,搜索引擎技术研究与发展[J].计算机工程,2005,31(14):54-56.
[17]	SEGURA S,DURa'N A,TROYA J,et al.A template-based approach to describing metamorphic relations[C]//Proceedings of IEEE/ACM International Workshop on Metamorphic Testing.Washington D.C.,USA:IEEE Press,2017:3-9.
[18]	惠战伟,黄松,李辉,等,蜕变关系形式化描述与分解技术[J].计算机工程与设计,2016,37(2):405-412.
[19]	周辉,曹兰芳.搜索引擎数据库更新策略比较分析[J].图书馆学研究,2012,19:50-55.
[20]	李宜兵.基于搜索引擎网页排序算法研究[D].沈阳:沈阳理工大学,2011.
[21]	茹立云,李智超,马少平.搜索引擎索引网页集合选取方法研究[J].计算机研究与发展,2014,51(10):2239-2247.

选择文件类型/文献管理软件名称

选择包含的内容

基于蜕变测试的面向用户搜索引擎性能分析

User-oriented Performance Analysis of Search Engine Based on Metamorphic Test

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 8

参考文献 21

相关文章 15

编辑推荐

Metrics

本文评价

[1]	陈俊月, 郝文宁, 张紫萱, 唐新德, 康睿智, 莫斐. 基于改进句子相似度算法的释义识别研究[J]. 计算机工程, 2020, 46(9): 76-82.
[2]	张浩盛伦,李翀,柯勇,张士波. 一种分布式用户浏览点击模型算法[J]. 计算机工程, 2019, 45(3): 1-6.
[3]	严锐,李石君. 基于查询意图识别与主题建模的文档检索算法[J]. 计算机工程, 2018, 44(3): 189-194.
[4]	王林,刘继源,马安进. 基于兴趣衰减的个性化排序算法[J]. 计算机工程, 2017, 43(9): 214-219,227.
[5]	张乃洲. 基于时间点击图挖掘的查询建议方法[J]. 计算机工程, 2015, 41(5): 191-196.
[6]	平宇，向阳，张波，黄寅飞. 基于MapReduce的并行PageRank算法实现[J]. 计算机工程, 2014, 40(2): 31-34,38.
[7]	张旭东，孙志明，刘亚宁，单栋栋，闫宏飞. 基于64位体系结构的倒排索引压缩算法[J]. 计算机工程, 2014, 40(2): 71-76.
[8]	方爽,殷俊杰,徐武平. 基于相似图片聚类的Web文本特征算法[J]. 计算机工程, 2014, 40(12): 161-165,171.
[9]	彭石, 周志彬, 王国军. 基于评分矩阵预填充的协同过滤算法178[J]. 计算机工程, 2013, 39(1): 175-178.
[10]	姚新磊, 庞建民, 岳峰, 余勇. 基于API依赖关系的代码相似度分析[J]. 计算机工程, 2013, 39(1): 80-84.
[11]	王东, 牛军钰. 基于多角度关联模型的实体检索方法[J]. 计算机工程, 2013, 39(1): 71-75.
[12]	义天鹏, 陈启安. 基于Lucene的中文分析器分词性能比较研究[J]. 计算机工程, 2012, 38(22): 279-282.
[13]	尹美娟, 王清贤, 刘晓楠. 结合网页和语句共现的Web社会关系评估[J]. 计算机工程, 2012, 38(22): 34-38.
[14]	张岩. 基于蜕变关系的多路径覆盖测试数据进化生成[J]. 计算机工程, 2012, 38(10): 57-59.
[15]	赵珂, 逯鹏, 李永强. 基于Lucene的搜索引擎设计与实现[J]. 计算机工程, 2011, 37(16): 39-41.

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于蜕变测试的面向用户搜索引擎性能分析

User-oriented Performance Analysis of Search Engine Based on Metamorphic Test

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 8

参考文献 21

相关文章 15

编辑推荐

Metrics

本文评价