计算机工程

• 人工智能及识别技术 • 上一篇    下一篇

基于增量式贝叶斯模型的中文问句分类研究

王小林,镇丽华,杨思春,邰伟鹏,郑 啸   

  1. (安徽工业大学计算机科学与技术学院,安徽马鞍山243002)
  • 收稿日期:2013-09-09 出版日期:2014-09-15 发布日期:2014-09-12
  • 作者简介:王小林(1964 - ),男,教授,主研方向:人工智能,中文信息处理;镇丽华,硕士研究生;杨思春,副教授、博士研究生;邰伟鹏, 讲师、博士研究生;郑 啸,教授、博士。
  • 基金项目:
    国家自然科学基金资助项目(61003311);安徽高校省级自然科学基金资助项目(KJ2011A040)。

Chinese Question Classification Research Based on Incremental Bayes Model

WANG Xiao-lin,ZHEN Li-hua,YANG Si-chun,TAI Wei-peng,ZHENG Xiao   

  1. WANG Xiao-lin,ZHEN Li-hua,YANG Si-chun,TAI Wei-peng,ZHENG Xiao
  • Received:2013-09-09 Online:2014-09-15 Published:2014-09-12

摘要: 固定训练集生成的分类器性能不理想且不能跟踪用户需求,为此,提出一种将增量式贝叶斯思想用于问句分类的方法。采用遗传算法选取最优特征子集优化分类器,从而避免训练集特征过分冗余,使分类器在学习过程中动态地扩大训练集并修改分类器参数。在对问句进行分类时,提取问句的疑问词、句法结构、疑问意向词和疑问意向词在知网的首项义原作为分类特征。为了验证增量式贝叶斯方法的有效性,从语料库中随机抽取不同规模的问句构成增量集,基于不同的增量集对同一测试集中的问句进行分类。实验结果表明,增量式贝叶斯分类器较朴素贝叶斯分类器有更高的分类精度,大类和小类的准确率分别达到90. 2% 和76. 3% ,在提高准确率的同时优化了运行效率。

关键词: 问句分类, 问答系统, 增量式贝叶斯, 朴素贝叶斯, 改进贝叶斯, 遗传算法

Abstract: Since the performance of the classifier generated by the fixed training set is not satisfactory and can hardly track the users’ needs dynamically,in this paper,the incremental Bayes idea is introduced in question classification. In order to eliminate the feature redundancy in the training set,Genetic Algorithm(GA) is used to select the optimal features to amend the classifier. In the process of classifier learning,the parameters are modified dynamically while the training set is expanded. The interrogative word, syntax structure, question focus words, and their first sememes are chosen as classification features. To verify the effectiveness of the proposed method,in the experiment,questions of different size at random are extracted from the corpus to build the incremental sets. Then classify the questions from the same test set based on different incremental sets. Experimental results show that the incremental Bayes classifier achieves better result. The classification accuracy of coarse classes and fine classes achieves 90. 2% and 76. 3% respectively. At the same time, it significantly optimizes the efficiency to some degree.

Key words: question classification, question answering system, incremental Bayes, naive Bayes, modified Bayes, Genetic Algorithm(GA)

中图分类号: