作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

›› 2005, Vol. 31 ›› Issue (16): 79-.

• 论文 • 上一篇    下一篇

在大型数据集上提高序列挖掘效率的统计方法

陆甡,李春平   

  1. 清华大学信息系统与工程实验室,清华大学软件学院,清华大学信息系统与工程实验室,清华大学软件学院 北京 100084
  • 发布日期:2005-08-25

A Statistical Method of Improving Efficiency on Sequential Patterns

LU Shen, LI Chunping   

  1. (Lab of Information System & Engineering,Tsinghua University, School of Software, Tsinghua University, Beijing 100084)
  • Published:2005-08-25

摘要: 分析了在大型事务集合发现频繁模式的特点,给出了一个改进算法(称为AprioriAdjust算法),同时,发展了两项技术:(1)提出了事务集合的压缩过程。(2)展示了一种基于统计模式的方法来评价序列的支持度,在该方法中,考虑了整个过程中每一趟的支持度均值的收敛性,以进行有效的候选频繁集的剪枝。此外,还讨论了实验结果。比较AprioriTID算法,研究展示,AprioriAdjust算法在进行大型事务集合的挖掘时更有效,可扩展性更强。

关键词: 数据挖掘, 序列模式挖掘, 最大频繁项目集, 统计模型

Abstract: This paper analyzes some features of discovering frequent patterns on large set of transactions. On this basis, it gives an improvedalgorithm (called AprioriAdjust) with the development of two techniques: (1) applying the compressive processing of the transaction set for miningsequential patterns; (2) presenting a method based on the statistical mechanism to evaluate the sequence’s support, in which the convergence ofaverage value of the support in the whole procedure is considered, so as to effectively prune the candidate set of the frequent patterns. Furthermore, itdiscusses the results of the experiments. Compared to the AprioriTID algorithm, it shows that the AprioriAdjust algorithm is more efficient andscalable over the large sets of transactions.

中图分类号: