作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2008, Vol. 34 ›› Issue (19): 212-214. doi: 10.3969/j.issn.1000-3428.2008.19.072

• 人工智能及识别技术 • 上一篇    下一篇

互联网话题识别与跟踪系统设计及实现

闵可锐1,赵迎宾1,刘 昕1,赵泽宇2,闫 华2   

  1. (1. 复旦大学计算机科学与工程系,上海 200433;2. 复旦大学信息化办公室,上海 200433)
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2008-10-05 发布日期:2008-10-05

Design and Implementation of Topic Detection and Tracking System on Web

MIN Ke-rui1, ZHAO Ying-bin1, LIU Xin1, ZHAO Ze-yu2, YAN Hua2   

  1. (1. Dept. of Computer Science & Engineering, Fudan University, Shanghai 200433; 2. Informationization Office, Fudan University, Shanghai 200433)
  • Received:1900-01-01 Revised:1900-01-01 Online:2008-10-05 Published:2008-10-05

摘要: 针对互联网上论坛和新闻网站发布的海量自然语言文本,该文设计一个话题识别与跟踪系统,将海量的数据分类整理并聚合形成各个话题。该系统的核心采用SVM方法进行文本分类,基于知识库和网络流算法实现话题的聚合,测试结果表明,文章分类的正确率达到92%,聚类的正确率达到88%,具有较高的应用价值。

关键词: 话题识别与跟踪, 信息检索, 支持向量机, 分类, 聚类

Abstract: This paper designs and implements a Topic Detection and Tracking(TDT) system to process the huge number of natural language text on Web. It classifies the text into several categories, performs clustering in each category to get the topic. The system can detect the hot topics in real-time and track some topics selected by user. The accuracy of text classification is 92%, and the accuracy of clustering is 88%. Experiment shows the feasibility of the TDT system.

Key words: Topic Detection and Tracking(TDT), information retrieval, SVM, classification, clustering

中图分类号: