计算机工程 ›› 2007, Vol. 33 ›› Issue (23): 12-15.doi: 10.3969/j.issn.1000-3428.2007.23.005

• 博士论文 • 上一篇    下一篇

基于信息补偿量的CID3算法的设计与分析

高 静,杨炳儒,徐章艳   

  1. (北京科技大学信息工程学院,北京 100083)
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2007-12-05 发布日期:2007-12-05

Design and Analysis of CID3 Algorithm Based on Compensative Information

GAO Jing, YANG Bing-ru, XU Zhang-yan   

  1. (Information Engineering School, University of Science and Technology Beijing, Beijing 100083)
  • Received:1900-01-01 Revised:1900-01-01 Online:2007-12-05 Published:2007-12-05

摘要: 在经典的ID3算法中,用“信息增益”作为选取检测属性启发信息,为了解决该算法存在的不足,该文提出了认识熵和信息补偿的概念,将属性的信息补偿量作为启发信息,设计了一个基于信息补偿量的CID3算法。实例分析表明,CID3算法比ID3算法更具有合理性。

关键词: 决策树, 信息补偿量, 认识熵, ID3算法, CID3算法

Abstract: In classical ID3 algorithm, “information plus” is regarded as illuminative information in selecting examing attribute. But it has the insufficiencies. In order to solve it, this paper brings forward cognitive entropy concept and information compensation concept, makes thinks of compensative information of the attribute as illuminative information, and designs a kind of CID3 algorithm based on compensative information. Aanalysts a great number of instances testify that CID3 algorithm has much more priority than ID3 algorithm.

Key words: decision tree, compensative information, cognition entropy, ID3 algorithm, CID3 algorithm

中图分类号: