基于证据理论的多分类器中文微博观点句识别

doi:10.3969/j.issn.1000-3428.2014.04.031

摘要/Abstract

摘要： 随着新技术及社会网络的发展与普及，微博用户数据量剧增，与此相关的研究引起了学术界和工业界的关注。针对中文微博语句特点，通过对比多种特征选取方法，提出一种新的特征统计方法。根据构建的词语字典与词性字典，分析支持向量机、朴素贝叶斯、K最近邻等分类模型，并利用证据理论结合多分类器对中文微博观点句进行识别。采用中国计算机学会自然语言处理与中文计算会议(NLP&CC 2012)提供的数据，运用该方法得到的准确率、召回率和F值分别为70.6%、89.2%、78.9%，而NLP&CC 2012公布的评测结果相应平均值分别为72.7%、61.5%、64.7%，该方法在召回率和F值2个指标上超过其平均值，而F值比NLP&CC 2012评测结果的最好值高出0.5%。

关键词: 微博, 观点句, 支持向量机, 朴素贝叶斯, K近邻, 证据理论

Abstract: With the development and popularity of the new technology and social network, the data volume of micro-blog users surge sharply. Related research causes increasing attention from both academia and industry. This paper proposes a new statistical method on feature extraction. Classification performances of different schemas such as Support Vector Machine(SVM), Naive Bayes and K-Nearest Neighbour(KNN) are analyzed carefully. It proposes a combined model based on D-S theory to take the advantages of different classifiers. A series of experiments based on the Chinese Micro-Blog data provided by CCF NLP&CC 2012 are conducted, and it gets the average estimate 72.7% in precision, 61.5% in recall and 64.7% in F-measure of NLP&CC 2012 as a baseline. Experimental results show that the method can achieve significant enhancement in both recall and F-measure with 70.6%, 89.2% and 78.9%, respectively, and F-measure is even 0.5% higher than the best result of NLP&CC 2012.

Key words: micro-blog, opinion sentence, Support Vector Machine(SVM), Naive Bayes, K-Nearest Neighbour(KNN), D-S theory

中图分类号:

TP18

郭云龙，潘玉斌，张泽宇，李莉. 基于证据理论的多分类器中文微博观点句识别[J]. 计算机工程, doi: 10.3969/j.issn.1000-3428.2014.04.031.

GUO Yun-long, PAN Yu-bin, ZHANG Ze-yu, LI Li. Multiple-classifiers Opinion Sentence Recognition in Chinese Micro-blog Based on D-S Theory[J]. Computer Engineering, doi: 10.3969/j.issn.1000-3428.2014.04.031.

参考文献

参考文献 [1] Kwak H, Lee C, Park H, et al. What Is Twitter, a Social Network or a News Media?[C]//Proceedings of the 19th International Conference on World Wide Web. Seattle, USA: ACM Press, 2010: 597-600. [2] Hu Minqing, Liu Bing. Mining and Summarizing Customer Reviews[C]//Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Stroudsburg, USA: ACM Press, 2004: 168-177. [3] Wilson T, Wiebe J, Hoffmann P. Recognizing Contextual Polarity in Phrase-level Sentiment Analysis[C]//Proceedings of Conference on Human Language Technology and Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACM Press, 2005: 347-354. [4] Jiang Long, Yu Mo, Zhou Ming, et al. Target-dependent Twitter Sentiment Classification[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, USA: [s. n.], 2011: 151-160. [5] 何凤英. 基于语义理解的中文博文倾向性分析[J]. 计算机应用, 2011, 31(8): 2130-2133. [6] Meena A, Prabhakar T V. Sentence Level Sentiment Analysis in the Presence of Conjuncts Using Linguistic Analysis[C]// Proceedings of the 29th European Conference on IR Research. Berlin, Germany: Springer-Verlag, 2007: 573-580. [7] Lu Yue, Castellanos M, Dayal U, et al. Automatic Construction of a Context-aware Sentiment Lexicon: an Optimization Approach[C]//Proceedings of the 20th International Con- ference on World Wide Web. [S. 1.]: ACM Press, 2011: 347-356. [8] 姚天昉, 彭思崴. 汉语主客观文本分类方法的研究[C]//第三届全国信息检索与内容安全学术会议论文集. 苏州: [出版者不详], 2007. [9] 刘志明, 刘鲁. 基于机器学习的中文微博情感分类实证研究[J]. 计算机工程与应用, 2012, 48(1): 1-4. [10] 王根, 赵军. 基于多重标记 CRF 句子情感分析的研究[C]//全国第九届计算机语言学学术会议论文集. 大连: [出版者不详], 2007. (下转第169页) (上接第163页) [11] Yu Hong, Hatzivassiloglou V. Towards Answering Opinion Questions: Separating Facts from Opinions and Identifying the Polarity of Opinion Sentences[C]//Proceedings of 2003 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: [s. n.], 2003: 129-136. [12] Davidov D, Tsur O, Rappoport A. Enhanced Sentiment Learning Using Twitter Hashtags and Smileys[C]//Proceedings of the 23rd International Conference on Computational Linguistics: Posters. Stroudsburg. Stroudsburg, USA: [s. n.], 2010: 241-249. [13] 侯敏, 滕永林, 李雪燕, 等. 话题型微博语言特点及其情感分析策略研究[EB/OL]. (2012-11-12). http://tcci.ccf.org.cn/ conference/2012/dldoc/NLPCC2012papers/workshoppapers/sen/003.pdf. [14] 谢丽星, 周明, 孙茂松. 基于层次结构的多策略中文微博情感分析和特征抽取[J]. 中文信息学报, 2012, 26(1): 73-83. [15] 张博. 基于 SVM 的中文观点句抽取[D]. 北京: 北京邮电大学, 2011. [16] 叶强, 张紫琼, 罗振雄. 面向互联网评论情感分析的中文主观性自动判别方法研究[J]. 信息系统学报, 2007, 1(1): 71-91 [17] 潘艳茜, 罗珞, 杨慧. 基于多分类器集成的中文微博情感分析[EB/OL]. (2012-11-12). http://tcci.ccf.org.cn/conference/ 2012/dldoc/NLPCC2012papers/workshoppapers/sen/012.pdf. [18] Dempster A P. Upper and Lower Probabilities Induced by a Multivalued Mapping[J]. The Annals of Mathematical Statistics, 1967, 38(2): 325-339. [19] 邓勇, 蒋雯, 韩德强. 广义证据理论的基本框架[J]. 西安交通大学学报, 2010, 44(12): 119-124. 编辑索书志