作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2012, Vol. 38 ›› Issue (13): 58-60,70. doi: 10.3969/j.issn.1000-3428.2012.13.016

• 软件技术与数据库 • 上一篇    下一篇

基于语义信息的中文短信文本相似度研究

刘金岭1,宋连友2,范玉虹2   

  1. (1. 淮阴工学院计算机工程学院,江苏 淮安 223003;2. 沧州师范学院计算机系,河北 沧州 061001)
  • 收稿日期:2011-09-09 出版日期:2012-07-05 发布日期:2012-07-05
  • 作者简介:刘金岭(1958-),男,教授,主研方向:数据库技术,数据挖掘;宋连友,讲师、硕士;范玉虹,副教授
  • 基金资助:
    河北省科技支撑计划基金资助项目(10213581);淮安科 技计划基金资助项目(HAG09061)

Study of Chinese SMS Text Similarity Based on Semantic Information

LIU Jin-ling  1, SONG Lian-you  2, FAN Yu-hong  2   

  1. (1. Computer Engineering Faculty, Huaiyin Institute of Technology, Huai’an 223003, China; 2. Department of Computer, Cangzhou Normal University, Cangzhou 061001, China)
  • Received:2011-09-09 Online:2012-07-05 Published:2012-07-05

摘要: 在传统TF-IDF模型基础上分析中文短信文本中特征词的语义信息,提出一种中文短信文本相似度度量方法。对短信文本进行预处理,计算各词语的TF-IDF值,并选择TF-IDF值较高的词作为特征词,借助向量空间模型的词语向量相似度,结合词语相似度加权,给出2篇短信文本相似度的计算方法。实验结果表明,该方法在F-度量值上优于TF-IDF算法及词语语义相似度算法。

关键词: 短信文本, 相似度, TF-IDF模型, 特征词, 向量空间模型

Abstract: This paper analyzes the semantic information of characteristic words in Chinese SMS text based on the traditional model TF-ID, and proposes a Chinese SMS text similarity measurement method. It preprocesses the SMS text, calculates TF-IDF values of each word, and selects high TF-IDF value of words as keywords. With word vector similarity of the Vector Space Model(VSM), combined with the word similarity weighted, it gives two SMS text similarity computing method. Experimental results show that the F-measure of this method is better than TF-IDF and word semantic similarity algorithm.

Key words: SMS text, similarity, TF-IDF model, characteristic word, Vector Space Model(VSM)

中图分类号: