作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2008, Vol. 34 ›› Issue (15): 47-50. doi: 10.3969/j.issn.1000-3428.2008.15.017

• 软件技术与数据库 • 上一篇    下一篇

一种有效的XML数据清洗方法

韩京宇1,2,成 瑜2,董逸生2   

  1. (1. 南京邮电大学计算机学院,南京 210003;2. 东南大学计算机科学与工程系,南京 210096)
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2008-08-05 发布日期:2008-08-05

Efficient Cleaning Approach for XML Data

HAN Jing-yu1,2, CHENG Yu2, DONG Yi-sheng2   

  1. (1. School of Computer, Nanjing University of Posts & Telecomunications, Nanjing 210003; 2. Department of Computer Science and Engineering, Southeast University, Nanjing 210096)
  • Received:1900-01-01 Revised:1900-01-01 Online:2008-08-05 Published:2008-08-05

摘要: 研究XML格式的重复数据元素的特点,提出对于特定应用领域,在具体的上下文环境中主动学习XML重复元素的识别规则。通过结构转换,将结构不尽相同的XML数据映射成结构一致的数据,并通过学习不同层次数据元素间的依赖关系权重来获得匹配规则。根据学习得到的转换和匹配规则,采用哈希过滤的方法来提高检测重复XML元素的效率。该方法能够有效地解决XML重复检测面临的结构多样性的问题,理论分析和实验表明,该方法有较高的精度和效率。

关键词: 主动学习, 匹配规则, 哈希

Abstract: By studying characteristics of duplicate XML data, this paper proposes an active machine learning method for a specific application, which is applied to glean transformation rules and matching rules, and accurately identify duplicate XML elements. Transfomation rules are used to eliminate the structural diversities among elements and matching rules are used to identify the relationships between parent and child nodes. In turn, during the detection phase an efficient hash filter algorithm is proposed to reduce computational complexity. Theory and experiment shows that the method can solve this problem efficiently and effectively.

Key words: active learning, matching rules, hash

中图分类号: