基于主题相似性聚类的自适应文本分类

doi:10.19678/j.issn.1000-3428.0053717

摘要/Abstract

摘要： 传统的文本分类方法仅使用一种模型进行分类，容易忽略不同类别特征词出现交叉的情况，影响分类性能。为提高文本分类的准确率，提出基于主题相似性聚类的文本分类算法。通过CHI和WordCount相结合的方法提取类特征词，利用K-means算法进行聚类并提取簇特征词构成簇特征词库。在此基础上，通过Adaptive Strategy算法自适应地选择fasttext、TextCNN或RCNN模型进行分类，得到最终分类结果。在AG News数据集上的实验结果表明，该算法可较好地解决不同类别特征词交叉的问题，与单独使用的fasttext、TextCNN、RCNN模型相比，其文本分类性能显著提升。

关键词: 文本分类, CHI方法, 特征提取, K-means算法, 自适应算法

Abstract: Traditional text classification method only uses one model for classification,so it is easy to ignore the overlapping of different categories of feature words,which affects the classification performance.To improve accuracy of text classification,this paper proposes a text classification algorithm based on topic similarity clustering.The algorithm combines CHI with WordCount to extract category feature words.Then it performs clustering using the K-means algorithm and extracts cluster feature words to constructs a cluster feature word library.On this basis,the Adaptive Strategy algorithm is used to adaptively choose fasttext,TextCNN or RCNN model for classification to obtain the final classification result.Experimental results on the AG News dataset show that the proposed algorithm can better solve overlapping of different categories of feature words,and significantly improves text classification performance compared with fasttext,TextCNN and RCNN models used alone.

Key words: text classification, CHI method, feature extraction, K-means algorithm, adaptive algorithm

中图分类号:

TP391

康雁, 杨其越, 李浩, 梁文韬, 李晋源, 崔国荣, 王沛尧. 基于主题相似性聚类的自适应文本分类[J]. 计算机工程, 2020, 46(3): 93-98.

KANG Yan, YANG Qiyue, LI Hao, LIANG Wentao, LI Jinyuan, CUI Guorong, WANG Peiyao. Adaptive Text Classification Based on Topic Similarity Clustering[J]. Computer Engineering, 2020, 46(3): 93-98.

https://www.ecice06.com/CN/Y2020/V46/I3/93

图/表 9

20200321084708

20200321084711

20200321084715

20200321084721

20200321084726

20200321084729

20200321084733

20200321084737

20200321084741

参考文献

[1] CHEN Liang,GUO Jiawen,WU Jiangong,et al.Research on artificial intelligence assisted decision-making algorithms for lawyers based on legal-computing theory[J].Journal of East China Normal University(Natural Sciences),2019(5):85-99.(in Chinese)陈亮,郭佳雯,武建功,等.基于法计算学理论的人工智能辅助决策算法研究[J].华东师范大学学报(自然科学版),2019(5):85-99.
[2] LI Tingting,LÜ Jia.Improved naive Bayes self-training algorithm based on weighted K nearest neighbors[J].Wuhan University Journal (Science Edition),2019,65(5):465-471.(in Chinese)李婷婷,吕佳.基于加权K最近邻改进朴素贝叶斯自训练算法[J].武汉大学学报(理学版),2019,65(5):465-471.
[3] SUN A,LIM E P,LIU Y.On strategies for imbalanced text classification using SVM:a comparative study[J].Decision Support Systems,2010,48(1):191-201.
[4] LI Fenggang,FAN Jili,WANG Li,et al.A method based on manifold learning and Bagging for text classification[C]//Proceedings of 2011 International Conference on Artificial Intelligence,Management Science and Electronic Commerce.Washington D.C.,USA:IEEE Press,2011:2713-2716.
[5] BLOEHDORN S,HOTHO A.Boosting for text classification with semantic features[C]//Proceedings of International Workshop on Advances in Web Mining and Web Usage Analysis.Berlin,Germany:Springer,2004:149-166.
[6] ZHANG Y,WALLACE B.A sensitivity analysis of (and practitioners' guide to) convolutional neural networks for sentence classification[EB/OL].[2019-01-01].https://arxiv.org/pdf/1510.03820.pdf.
[7] LIU Pengfei,QIU Xipeng,HUANG Xuanjing.Recurrent neural network for text classification with multi-task learning[EB/OL].[2019-01-01].https://arxiv.org/pdf/1605.05101.pdf.
[8] XIE Jinbao,HOU Yongjin,KANG Shouqiang,et al.Multi-feature fusion based on semantic understanding attention neural network for Chinese text categorization[J].Journal of Electronics and Information Technology,2018,40(5):246-253.(in Chinese)谢金宝,侯永进,康守强,等.基于语义理解注意力神经网络的多元特征融合中文文本分类[J].电子与信息学报,2018,40(5):246-253.
[9] KIM Y.Convolutional neural networks for sentence classification[EB/OL].[2019-01-01].https://arxiv.org/pdf/1408.5882.pdf.
[10] GONG Qianjian.Text classification based on recurrent neural network model[D].Wuhan:Huazhong University of Science and Technology,2016.(in Chinese)龚千健.基于循环神经网络模型的文本分类[D].武汉:华中科技大学,2016.
[11] GREFF K,SRIVASTAVA R K,KOUTNÍK J,et al.LSTM:a search space odyssey[J].IEEE Transactions on Neural Networks and Learning Systems,2015,28(10):2222-2232.
[12] GRAVES A.Generating sequences with recurrent neural networks[EB/OL].[2019-01-01].https://arxiv.org/pdf/1308.0850.pdf.
[13] LIANG Jun,CHAI Yumei,YUAN Huibin,et al.Polarity shifting and LSTM based recursive networks for sentiment analysis[J].Journal of Chinese Information Processing,2015,29(5):152-160.(in Chinese)梁军,柴玉梅,原慧斌,等.基于极性转移和LSTM递归网络的情感分析[J].中文信息学报,2015,29(5):152-160.
[14] KHAN A,BAHARUDIN B,KHAN K.Efficient feature selection and domain relevance term weighting method for document classification[C]//Proceedings of International Conference on Computer Engineering and Applications.Washington D.C.,USA:IEEE Computer Society,2010:152-159.
[15] ZHANG X,ZHAO J,LECUN Y.Character-level convolutional networks for text classification[C]//Proceedings of International Conference on Neural Information Processing Systems.Cambridge,USA:MIT Press,2015:649-657.
[16] YANG Y,PEDERSEN J O.A comparative study on feature selection in text categorization[C]//Proceedings of International Conference on Machine Learning.New York,USA:ACM Press,1997:412-420.
[17] ZHOU Qingping,TAN Changgeng,WANG Hongjun,et al.Improved KNN text classification algorithm based on clustering[J].Application Research of Computers,2016,33(11):3374-3377.(in Chinese)周庆平,谭长庚,王宏君,等.基于聚类改进的KNN文本分类算法[J].计算机应用研究,2016,33(11):3374-3377.
[18] LAI Siwei,XU Liheng,LIU Kang,et al.Recurrent convolutional neural networks for text classification[C]//Proceedings of the 29th AAAI Conference on Artificial Intelligence.Reston,USA:American Institute of Aeronautics and Astronautic,2015:2267-2273.
[19] JOULIN A,GRAVE E,BOJANOWSKI P,et al.Bag of tricks for efficient text classification[EB/OL].[2019-01-01].https://arxiv.org/pdf/1607.01759.pdf.
[20] KALCHBRENNER N,GREFENSTETTE E,BLUNSOM P.A convolutional neural network for modelling sentences[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.Stroudsburg,USA:Association for Computational Linguistics,2014:1-11.
[21] JOHNSON R,ZHANG T.Deep pyramid convolutional neural networks for text categorization[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,USA:Association for Computational Linguistics,2017:562-570.

选择文件类型/文献管理软件名称

选择包含的内容