基于卷积神经网络和KNN的短文本分类算法研究

doi:10.19678/j.issn.1000-3428.0047596

计算机工程 ›› 2018, Vol. 44 ›› Issue (7): 193-198. doi: 10.19678/j.issn.1000-3428.0047596

基于卷积神经网络和KNN的短文本分类算法研究

殷亚博^a,杨文忠^a,杨慧婷 ^a,许超英^b

新疆大学 a.信息科学与工程学院; b.软件学院,乌鲁木齐 830046

收稿日期:2017-06-14 出版日期:2018-07-15 发布日期:2018-07-15
作者简介:殷亚博(1990—),男,硕士研究生,主研方向为机器学习、自然语言处理;杨文忠,副教授、博士;杨慧婷、许超英,硕士研究生。
基金资助:
国家重点基础研究发展计划项目(2014CB340500);国家自然科学基金(U1603115,61262087)。

Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN

YIN Yabo^a,YANG Wenzhong^a,YANG Huiting^a,XU Chaoying^b

a.College of Information Science and Engineering; b.School of Software,Xinjiang University,Urumqi 830046,China

Received:2017-06-14 Online:2018-07-15 Published:2018-07-15

摘要/Abstract

摘要：

为解决传统基于TF-IDF的K最近邻(KNN)分类算法在短文本分类时,出现特征维度过高和数据稀疏的问题,基于卷积神经网络和KNN,提出一种新的短文本分类算法。通过采用神经网络语言模型word2vec对短文本进行词向量的训练,并用训练好的词向量表示文本,使用卷积神经网络对短文本进行抽象特征的提取,在提取出抽象特征的基础上,运用KNN分类器进行短文本分类。分别在短文本中句子数目为2、4、6、8的数据集上进行测试,结果表明,与基于TF-IDF的KNN分类算法相比,该算法在准确率、召回率和F1值上平均提高了10.2%、21.1%和15.5% 。

关键词: 社交网络, 卷积神经网络, K最近邻, 短文本, 机器学习, 深度学习

Abstract:

In order to solve the problem of high dimension and sparse data in the traditional K-Nearest Neighbor(KNN) short text classification algorithm based on TF-IDF,a short text classification algorithm based on convolutional neural network and KNN is proposed.The word vector is trained by word2vec which is a kind of neural network language model and used to represent the short text.These abstract features of short text are extracted by using the model of Convolutional Neural Network.The short text is classified by the KNN classifier based on the extracted abstract features.Experiments are performed on the data set which the number of sentences in short texts is 2,4,6 and 8 respectively.Experimental results show that compared with the KNN classification algorithm based on TF-IDF,this algorithm has an average increase of 10.2%,21.1% and 15.5% respectively in accuracy rate,recall rate and F1 value.

Key words: social network, Convolutional Neural Network(CNN), K-Nearest Neighbor(KNN), short text, machine learning, deep learning

中图分类号:

TP391

殷亚博,杨文忠,杨慧婷,许超英. 基于卷积神经网络和KNN的短文本分类算法研究[J]. 计算机工程, 2018, 44(7): 193-198.

YIN Yabo,YANG Wenzhong,YANG Huiting,XU Chaoying. Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN[J]. Computer Engineering, 2018, 44(7): 193-198.

https://www.ecice06.com/CN/Y2018/V44/I7/193

参考文献

［1］WANG S,MANNING C D.Baselines and bigrams:simple,good sentiment and topic classification［C］//Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics.［S.l.］:Association for Computational Linguistics,2012:90-94.
［2］邸鹏,段利国.一种新型朴素贝叶斯文本分类算法［J］.数据采集与处理,2014,29(1):71-75.
［3］张玉芳,彭时名,吕佳等.基于文本分类TFIDF方法的改进与应用［J］.计算机工程,2006,32(19):76-78.
［4］张宁,贾自艳,史忠植,等.使用KNN算法的文本分类［J］.计算机工程,2005,31(8):171-172.
［5］GAUTAM G,YADAV D.Sentiment analysis of twitter data using machine learning approaches and semantic analysis［C］//Proceedings of the 7th International Conference on Contemporary Computing.Washington D.C.,USA:IEEE Press,2014:437-442.
［6］AGARWAL A,XIE B,VOVSHA I,et al.Sentiment analysis of twitter data［C］//Proceedings of Workshop on Languages in Social Media.Portland,Oregon:Association for Computational Linguistics,2011:30-38.
［7］BHUTA S,DOSHI A,DOSHI U,et al.A review of techniques for sentiment analysis of twitter data［C］// International Conference on Issues and Challenges in Intelligent Computing Techniques.Washington D.C.,USA:IEEE Press,2014:583-591.
［8］BENGIO Y,SCHWENK H,SENECAL J,et al.Neural probabilistic language models［J］.Journal of Machine Learning Research,2003,3(6):1137-1155.
［9］YIH W,TOUTANOVA K,PLATT J C,et al.Learning discriminative projections for text similarity measures［C］//Proceedings of the 15th Conference on Computational Natural Language Learning.Portland,Oregon:Association for Computational Linguistics,2011:247-256.
［10］PACCANARO A,HINTON G E.Learning distributed representations of concepts using linear relational embedding［J］.IEEE Transactions on Knowledge and Data Engineering,2001,13(2):232-244.
［11］杜昌顺,黄磊.分段卷积神经网络在文本情感分析中的应用［J］.计算机工程与科学,2017,39(1):173-179.
［12］陈翠平.基于深度信念网络的文本分类算法［J］.计算机系统应用,2015,24(2):121-126.
［13］张春云,秦鹏达,尹义龙,等.基于卷积神经网络的自适应权重multi-gram语句建模系统［J］.计算机科学,2017,44(1):60-64.
［14］KO D G,SONG S H,KANG K M,et al.Convolutional neural networks for character-level classification［J］.IEEE Transactions on Smart Processing & Computing,2017,6(1):53-59.
［15］VIEIRA J P A,MOURA R S.An analysis of convolutional neural networks for sentence classification［C］//Proceedings of IEEE Computer Conference.Washington D.C.,USA:IEEE Press,2017:1-5.
［16］MENG J E,ZHANG Y,WANG N,et al.Attention pooling-based convolutional neural network for sentence modeling［J］.Information Sciences an International Journal,2016,373(C):388-403.
［17］CONNEAU A,SCHWENK H,BARRAULT L,et al.Very deep convolutional networks for text classi-fication［C］//Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics.Vancouver,Canada:Association for Computational Linguistics,2017:1107-1116.
［18］LAWRENCE S,GILES C L,TSOI A C,et al.Face recognition:a convolutional neural-network approach［J］.IEEE Transactions on Neural Network,1997,8(1):98-113.
［19］MA L,LU Z,SHANG L,et al.Multimodal convolutional neural networks for matching image and sentence［C］//Proceedings of IEEE International Conference on Computer Vision.Washington D.C.,USA:IEEE Computer Society,2015:2623-2631.

[1]	魏嵬, 丁香香, 郭梦星, 杨钊, 刘辉. 文本相似度计算方法综述[J]. 计算机工程, 2024, 50(9): 18-32.
[2]	王志浩, 钱沄涛. 基于Swin Transformer的双流遥感图像时空融合超分辨率重建[J]. 计算机工程, 2024, 50(9): 33-45.
[3]	李俊俊, 董建刚, 李坤. 基于Kubernetes的集群节能策略研究[J]. 计算机工程, 2024, 50(9): 82-91.
[4]	张鲁, 田春伟, 宋焕生, 刘侍刚. 用于低剂量CT图像去噪的多级双树复小波网络[J]. 计算机工程, 2024, 50(9): 266-275.
[5]	朱凯, 李理, 张彤, 江晟, 别一鸣. 基于Transformer的多阶段运动模糊图像修复网络[J]. 计算机工程, 2024, 50(9): 276-285.
[6]	张天鹏, 韩晶, 吕学强. 基于多任务学习的超分辨率辅助小目标检测[J]. 计算机工程, 2024, 50(9): 304-312.
[7]	高煜宝, 文志诚. 基于注意力机制的双路解码器图像去噪方法[J]. 计算机工程, 2024, 50(9): 324-332.
[8]	张华青, 夏张涛, 陆晓庆, 童基均. 基于字形特征的血管外科命名实体识别[J]. 计算机工程, 2024, 50(8): 13-21.
[9]	王蕾, 党时鹏, 潘丰. 基于卷积神经网络的隐匿性旁路预测模型[J]. 计算机工程, 2024, 50(8): 40-49.
[10]	张亚洲, 和玉, 戎璐, 王祥凯. 基于上下文知识增强型Transformer网络的抑郁检测[J]. 计算机工程, 2024, 50(8): 75-85.
[11]	高伟, 李帅龙, 茆琳, 王磊, 李颖颖, 韩林. 一种基于TVM的算子生成加速策略[J]. 计算机工程, 2024, 50(8): 353-362.
[12]	钱榕, 李鑫, 刘晓豫, 张克君, 郭竞桧, 叶仲昆. 考虑禁言机制的谣言传播模型[J]. 计算机工程, 2024, 50(8): 372-378.
[13]	王宇, 祁琦, 王纯, 许才. 储能变流器信号高精度故障诊断方法[J]. 计算机工程, 2024, 50(8): 389-396.
[14]	耿丽丽, 牛保宁. 基于通道相似度熵的卷积神经网络裁剪[J]. 计算机工程, 2024, 50(7): 133-143.
[15]	张洋, 刘畅, 李少青. 基于可控制性度量的图神经网络门级硬件木马检测方法[J]. 计算机工程, 2024, 50(7): 164-173.

选择文件类型/文献管理软件名称

选择包含的内容

基于卷积神经网络和KNN的短文本分类算法研究

Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于卷积神经网络和KNN的短文本分类算法研究

Research on Short Text Classification Algorithm Based on Convolutional Neural Network and KNN

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价