作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2010, Vol. 36 ›› Issue (7): 173-175,. doi: 10.3969/j.issn.1000-3428.2010.07.059

• 人工智能及识别技术 • 上一篇    下一篇

含有语义特征的网页新闻自动抽取

施 洋,张 奇,黄萱菁

  

  1. (复旦大学计算机科学技术学院,上海 200433)
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2010-04-05 发布日期:2010-04-05

Automatic Web News Extraction with Semantic Features

SHI Yang, ZHANG Qi, HUANG Xuan-jing   

  1. (School of Computer Science, Fudan University, Shanghai 200433)
  • Received:1900-01-01 Revised:1900-01-01 Online:2010-04-05 Published:2010-04-05

摘要: 通过分析新闻网页的语义特征以及网页之间存在的通用性质,提出一种含有语义特征的网页新闻自动抽取方法,包括利用语义分类器识别新闻网页中的种子信息以及页面中的局部信息来完成抽取。在分类器中加入语义特征可以使F1值达到94.2%。在语义分类器与局部特征结合的情况下,F1值可以达到96.9%。实验结果证明,该方法能有效提高网页信息抽取算法的精度,降低机器学习所需要的标注成本。

关键词: 网络信息抽取, 语义特征, 局部特征

Abstract: This paper analyzes the semantic features and the similarity of Web news pages, and presents an automatic Web news extraction method with semantic features. It utilizes semantic classifier to find the seed information, and uses portion features to build information extraction rules. The F1-Value of Web news extraction can reach to 94.2% when add semantic features to classifier. The performance of F1-Value can reach to 96.9% when combine semantic classifier and portion features based information extraction method. Experimental result shows that the method can effectively improve the accuracy of Web information extraction method and cut the cost of manual labeling work.

Key words: Web information extraction, semantic features, portion features

中图分类号: