基于卷积神经网络和KNN的短文本分类算法研究

doi:10.19678/j.issn.1000-3428.0047596

计算机工程 ›› 2018, Vol. 44 ›› Issue (7): 193-198. doi: 10.19678/j.issn.1000-3428.0047596

基于卷积神经网络和KNN的短文本分类算法研究

殷亚博^a,杨文忠^a,杨慧婷 ^a,许超英^b

新疆大学 a.信息科学与工程学院; b.软件学院,乌鲁木齐 830046

收稿日期:2017-06-14 出版日期:2018-07-15 发布日期:2018-07-15
作者简介:殷亚博(1990—),男,硕士研究生,主研方向为机器学习、自然语言处理;杨文忠,副教授、博士;杨慧婷、许超英,硕士研究生。
基金资助:
国家重点基础研究发展计划项目(2014CB340500);国家自然科学基金(U1603115,61262087)。

Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN

YIN Yabo^a,YANG Wenzhong^a,YANG Huiting^a,XU Chaoying^b

a.College of Information Science and Engineering; b.School of Software,Xinjiang University,Urumqi 830046,China

Received:2017-06-14 Online:2018-07-15 Published:2018-07-15

摘要/Abstract

摘要：

为解决传统基于TF-IDF的K最近邻(KNN)分类算法在短文本分类时,出现特征维度过高和数据稀疏的问题,基于卷积神经网络和KNN,提出一种新的短文本分类算法。通过采用神经网络语言模型word2vec对短文本进行词向量的训练,并用训练好的词向量表示文本,使用卷积神经网络对短文本进行抽象特征的提取,在提取出抽象特征的基础上,运用KNN分类器进行短文本分类。分别在短文本中句子数目为2、4、6、8的数据集上进行测试,结果表明,与基于TF-IDF的KNN分类算法相比,该算法在准确率、召回率和F1值上平均提高了10.2%、21.1%和15.5% 。

关键词: 社交网络, 卷积神经网络, K最近邻, 短文本, 机器学习, 深度学习

Abstract:

In order to solve the problem of high dimension and sparse data in the traditional K-Nearest Neighbor(KNN) short text classification algorithm based on TF-IDF,a short text classification algorithm based on convolutional neural network and KNN is proposed.The word vector is trained by word2vec which is a kind of neural network language model and used to represent the short text.These abstract features of short text are extracted by using the model of Convolutional Neural Network.The short text is classified by the KNN classifier based on the extracted abstract features.Experiments are performed on the data set which the number of sentences in short texts is 2,4,6 and 8 respectively.Experimental results show that compared with the KNN classification algorithm based on TF-IDF,this algorithm has an average increase of 10.2%,21.1% and 15.5% respectively in accuracy rate,recall rate and F1 value.

Key words: social network, Convolutional Neural Network(CNN), K-Nearest Neighbor(KNN), short text, machine learning, deep learning

中图分类号:

TP391

殷亚博,杨文忠,杨慧婷,许超英. 基于卷积神经网络和KNN的短文本分类算法研究[J]. 计算机工程, 2018, 44(7): 193-198.

YIN Yabo,YANG Wenzhong,YANG Huiting,XU Chaoying. Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN[J]. Computer Engineering, 2018, 44(7): 193-198.

http://www.ecice06.com/CN/Y2018/V44/I7/193

参考文献

［1］WANG S,MANNING C D.Baselines and bigrams:simple,good sentiment and topic classification［C］//Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics.［S.l.］:Association for Computational Linguistics,2012:90-94.
［2］邸鹏,段利国.一种新型朴素贝叶斯文本分类算法［J］.数据采集与处理,2014,29(1):71-75.
［3］张玉芳,彭时名,吕佳等.基于文本分类TFIDF方法的改进与应用［J］.计算机工程,2006,32(19):76-78.
［4］张宁,贾自艳,史忠植,等.使用KNN算法的文本分类［J］.计算机工程,2005,31(8):171-172.
［5］GAUTAM G,YADAV D.Sentiment analysis of twitter data using machine learning approaches and semantic analysis［C］//Proceedings of the 7th International Conference on Contemporary Computing.Washington D.C.,USA:IEEE Press,2014:437-442.
［6］AGARWAL A,XIE B,VOVSHA I,et al.Sentiment analysis of twitter data［C］//Proceedings of Workshop on Languages in Social Media.Portland,Oregon:Association for Computational Linguistics,2011:30-38.
［7］BHUTA S,DOSHI A,DOSHI U,et al.A review of techniques for sentiment analysis of twitter data［C］// International Conference on Issues and Challenges in Intelligent Computing Techniques.Washington D.C.,USA:IEEE Press,2014:583-591.
［8］BENGIO Y,SCHWENK H,SENECAL J,et al.Neural probabilistic language models［J］.Journal of Machine Learning Research,2003,3(6):1137-1155.
［9］YIH W,TOUTANOVA K,PLATT J C,et al.Learning discriminative projections for text similarity measures［C］//Proceedings of the 15th Conference on Computational Natural Language Learning.Portland,Oregon:Association for Computational Linguistics,2011:247-256.
［10］PACCANARO A,HINTON G E.Learning distributed representations of concepts using linear relational embedding［J］.IEEE Transactions on Knowledge and Data Engineering,2001,13(2):232-244.
［11］杜昌顺,黄磊.分段卷积神经网络在文本情感分析中的应用［J］.计算机工程与科学,2017,39(1):173-179.
［12］陈翠平.基于深度信念网络的文本分类算法［J］.计算机系统应用,2015,24(2):121-126.
［13］张春云,秦鹏达,尹义龙,等.基于卷积神经网络的自适应权重multi-gram语句建模系统［J］.计算机科学,2017,44(1):60-64.
［14］KO D G,SONG S H,KANG K M,et al.Convolutional neural networks for character-level classification［J］.IEEE Transactions on Smart Processing & Computing,2017,6(1):53-59.
［15］VIEIRA J P A,MOURA R S.An analysis of convolutional neural networks for sentence classification［C］//Proceedings of IEEE Computer Conference.Washington D.C.,USA:IEEE Press,2017:1-5.
［16］MENG J E,ZHANG Y,WANG N,et al.Attention pooling-based convolutional neural network for sentence modeling［J］.Information Sciences an International Journal,2016,373(C):388-403.
［17］CONNEAU A,SCHWENK H,BARRAULT L,et al.Very deep convolutional networks for text classi-fication［C］//Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics.Vancouver,Canada:Association for Computational Linguistics,2017:1107-1116.
［18］LAWRENCE S,GILES C L,TSOI A C,et al.Face recognition:a convolutional neural-network approach［J］.IEEE Transactions on Neural Network,1997,8(1):98-113.
［19］MA L,LU Z,SHANG L,et al.Multimodal convolutional neural networks for matching image and sentence［C］//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Computer Society,2015:2623-2631.

[1]	江雨燕, 陶承凤, 李平. 数据增强和自适应自步学习的深度子空间聚类算法[J]. 计算机工程, 2023, 49(8): 96-103, 110.
[2]	李泽水, 冀俊忠, 杨翠翠. 基于边权重信息深度网络嵌入的PPIN功能模块检测[J]. 计算机工程, 2023, 49(8): 69-76.
[3]	王可铮, 徐玉芬, 周尚波. 结合对比感知损失和融合注意力的图像去雾模型[J]. 计算机工程, 2023, 49(8): 207-214.
[4]	刘俊豪, 王美林, 谢兴, 宋烨兴, 许莉花. 基于改进YOLOv5的皮革瑕疵检测算法[J]. 计算机工程, 2023, 49(8): 240-249.
[5]	曹坪, 杨怀志, 薄一军, 尤嘉, 张淳杰, 李丹勇. 面向低质量裂缝图像的多知识蒸馏分类[J]. 计算机工程, 2023, 49(7): 204-213.
[6]	白明昌. 基于折叠路径聚合的属性网络节点嵌入方法[J]. 计算机工程, 2023, 49(7): 76-84.
[7]	闫兴亚, 匡娅茜, 白光睿, 李月. 基于深度学习的学生课堂行为识别方法[J]. 计算机工程, 2023, 49(7): 251-258.
[8]	李军侠, 王星驰, 殷梓, 石德硕. 边缘深度挖掘的弱监督显著性目标检测[J]. 计算机工程, 2023, 49(7): 169-178.
[9]	吴珊, 周凤. 基于改进SSD算法的小目标检测[J]. 计算机工程, 2023, 49(7): 179-188.
[10]	席建锐, 唐红梅, 梁春阳, 刘鑫. 基于改进隐函数的点云物体重建[J]. 计算机工程, 2023, 49(7): 214-222.
[11]	齐咏生, 杜晓旭, 朱俊峰, 高胜利, 刘利强. 基于增强型轻量深度网络的牧区牲畜高效检测[J]. 计算机工程, 2023, 49(7): 278-287.
[12]	张博旭, 蒲智, 程曦. 基于提示学习的维吾尔语文本分类研究[J]. 计算机工程, 2023, 49(6): 292-299,313.
[13]	于海洋, 景鹏, 张文涛, 谢赛飞, 滑志华, 宋草原. 基于残差与注意力机制的道路裂缝检测U-Net改进模型[J]. 计算机工程, 2023, 49(6): 265-273.
[14]	谌雨章, 黄逸姿, 张钧涵. 基于多速率空洞卷积的多尺度水下小目标检测[J]. 计算机工程, 2023, 49(6): 257-264.
[15]	代祖华, 刘园园, 狄世龙. 语义增强的图神经网络方面级文本情感分析[J]. 计算机工程, 2023, 49(6): 71-80.

选择文件类型/文献管理软件名称

选择包含的内容

基于卷积神经网络和KNN的短文本分类算法研究

Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于卷积神经网络和KNN的短文本分类算法研究

Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价