计算机工程 ›› 2019, Vol. 45 ›› Issue (10): 52-56,63.doi: 10.19678/j.issn.1000-3428.0053243

• 体系结构与软件技术 • 上一篇    下一篇

基于蜕变测试的面向用户搜索引擎性能分析

杨正龙, 高建华   

  1. 上海师范大学 计算机科学与技术系, 上海 200234
  • 收稿日期:2018-11-26 修回日期:2019-01-06 出版日期:2019-10-15 发布日期:2019-01-24
  • 作者简介:杨正龙(1995-),男,硕士研究生,主研方向为软件测试;高建华,教授、博士。
  • 基金项目:
    国家自然科学基金(61672355)。

User-oriented Performance Analysis of Search Engine Based on Metamorphic Test

YANG Zhenglong, GAO Jianhua   

  1. Department of Computer Science and Technology, Shanghai Normal University, Shanghai 200234, China
  • Received:2018-11-26 Revised:2019-01-06 Online:2019-10-15 Published:2019-01-24

摘要: 面对海量的互联网信息,用户在进行搜索时缺乏客观公认的Oracle验证搜索引擎所返回结果是否正确。为此,将蜕变测试应用于搜索引擎的性能测试。针对搜索引擎Baidu、Bing和360,结合搜索操作符定义相应的蜕变关系,对其检索能力和排序稳定性进行测试,并通过异常率和平均Jaccard系数量化测试结果。分析结果表明,在搜索引擎Baidu、Bing和360中,Bing的异常率最低,Baidu的排序稳定性最高,三者对于不同领域的关键词搜索表现相差不大,但对于不同语言搜索表现存在很大差别。该结果为不同领域用户在选择合适的搜索引擎时提供了参考,同时可帮助搜索引擎的开发人员发现和移除程序中的错误。

关键词: 搜索引擎, 蜕变测试, 蜕变关系, Oracle问题, 异常率, Jaccard系数

Abstract: Facing a large amount of Internet information,users lack an objective recognized Oracle to verify whether the results returned by the search engine are correct or not.Therefore,the metamorphic test is applied for search engine performance test.For search engines like Baidu,Bing and 360,the corresponding metamorphic relationship is defined by combining search operators.Their retrieval ability and sorting stability are tested,and the test results are quantified by abnormal rate and average Jaccard coefficient.Analysis results show that,among search engines Baidu,Bing and 360,Bing has the lowest abnormal rate and Baidu has the highest ranking stability.Meanwhile,Baidu,Bing and 360 have little difference in keyword search performance in different fields,but there are big differences in search performance of different languages.The results provide a reference for users of different domain when choosing the right search engine,and help search engine developers to find and remove errors in the program.

Key words: search engine, metamorphic test, metamorphic relation, Oracle problem, abnormal rate, Jaccard coefficient

中图分类号: