Abstract: Content information is the topic information of a Web page excluding links, navigations, advertisement and so on. This paper proposes and implements an information extraction algorithm including content Web page. By taking a top-down traversing of HTML tag tree of Web page and continuously analyzing the statistics within like text link rate and continuous text length, it can locate the best content information region and extract the text content. Experimental results show the high feasibility and accuracy rate of the algorithm.

Key words: content information localization, text link rate, best content sub tree, tag tree

摘要： 正文信息是一个Web网页中除了链接、导航、广告等以外的主题信息。提出并实现一种针对含“正文”的Web页面的信息提取算法。该算法采用自顶向下遍历HTML标签树的方法，通过文字链接率、连续文字长度等统计数据不断筛选、分析，从而定位最佳正文信息域，将文字内容提取出来。实验结果表明，该算法可行性强，具有较高的准确率。

关键词: 正文信息定位, 文字链接率, 最佳正文子树, 标签树

CLC Number: 

• TP311