一种混合语种文本的多维度多情感分析方法

doi:10.19678/j.issn.1000-3428.0055734

摘要/Abstract

摘要： 针对中英混合微博文本情感分析问题，提出一种新的多维度多情感分析方法。将中英混合语言文本分别翻译成中文和英文，提取文本在不同语言维度的特征，基于中英混合语言、中文、英文分别提取对应的语义信息，综合上述3种从不同语言维度获取的语义信息，构建一个多情感分类模型并进行训练微调，根据情感概率得到最终的分类结果。实验结果表明，相比单一的处理方法，该方法能够更全面地提取中英混合文本的语义特征，并精准地判别文本中的多种情感，具有较好的分类效果。

关键词: 中英混合微博, 多情感分析, 多维度方法, BERT模型, 迁移学习

Abstract: To address the emotion analysis of Chinese-English code-mixed microblog texts,this paper proposes a new multi-dimensional and multi-emotion analysis method.The Chinese-English code-mixed texts are translated into Chinese and English respectively,and features of the texts in different language dimensions are extracted.Then the corresponding semantic information is extracted based on the Chinese-English mixed language,Chinese and English.By combining the three kinds of semantic information extracted from different language dimensions,a multi-emotion classification model is constructed and trained for fine tuning.Finally,the classification result is obtained based on the emotional probability.Experimental results show that compared with simple processing methods,the proposed method more comprehensively extracts the semantic features of Chinese-English code-mixed texts,accurately distinguishes multiple emotions in the text,and has a better classification effect.

Key words: Chinese-English mixed microblogs, multi-emotion analysis, multi-dimensional method, BERT model, transfer learning

中图分类号:

TP183

李妍慧, 郑超美, 王炜立, 杨昕. 一种混合语种文本的多维度多情感分析方法[J]. 计算机工程, 2020, 46(12): 113-119,141.

LI Yanhui, ZHENG Chaomei, WANG Weili, YANG Xin. A Multi-Dimensional and Multi-Emotion Analysis Method for Mixed Language Texts[J]. Computer Engineering, 2020, 46(12): 113-119,141.

http://www.ecice06.com/CN/Y2020/V46/I12/113

图/表 12

20201216140937

20201216141104

20201216141107

20201216141110

20201216141114

20201216141117

20201216141120

20201216141123

20201216141126

20201216141130

20201216141133

20201216141136

参考文献

[1] TANG Xiaobo,LIU Yiping.Cross-lingual fine-grained sentiment analysis based on dependency parsing[J].Information Studies:Theory and Application,2018,41(6):124-129.(in Chinese) 唐晓波,刘一平.基于依存句法的跨语言细粒度情感分析[J].情报理论与实践,2018,41(6):124-129.
[2] DUH K,FUJINO A,NAGATA M.Is machine translation ripe for cross-lingual sentiment classification?[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:Human Language Technologies:Short Papers.[S.1.]:Association for Computational Linguistics,2011:429-433.
[3] ZHOU Guiyou,ZHU Zhiyuan,HE Tingting,et al.Cross-lingual sentiment classification with stacked autoencoders[J].Knowledge and Information Systems,2016,47(1):27-44.
[4] HAJMOHAMMADI M S,IBRAHIM R,SELAMAT A.Bi-view semi-supervised active learning for cross-lingual sentiment classification[J].Information Processing and Management,2014,50(5):718-732.
[5] PRETTANHOFER P,STEIN B.Cross-lingual adaptation using structural correspondence learning[J].ACM Transactions on Intelligent Systems and Technology,2011,3(1):1-13.
[6] BLIATZER J,DREDZE M,PEREIRA F,et al.Biographies,Bollywood,boom-boxes and blenders:domain adaptation for sentiment classification[C]//Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics.Prague,Czech Republic:Association for Computational Linguistics,2007:440-447.
[7] WANG Peng,ZHAO Xueli,LI Nana,et al.Research of cross-language sentiment classification based on structural correspondence learning[J].Journal of Nanjing University(Natural Science),2017,53(6):1133-1140.(in Chinese) 汪鹏,赵学礼,李娜娜,等.基于结构对应学习的跨语言情感分类研究[J].南京大学学报(自然科学版),2017,53(6):1133-1140.
[8] LI Nana,ZHAI Shuangfei,ZHANG Zhongfei,et al.Structural correspondence learning for cross-lingual sentiment classification with one-to-many mappings[EB/OL].[2019-07-10].http://export.arxiv.org/abs/1611.08737.
[9] ZHANG Hu,ZHOU Aimin,SONG Shenmin,et al.A self-organizing multi-objective evolutionary algorithm[J].IEEE Transactions on Evolutionary Computation,2016,20(5):792-806.
[10] ZHOU Guangyou,HE Tingting,ZHAO Jun.Bridging the language gap:learning distributed semantics for cross-lingual sentiment classification[C]//Proceedings of NLPC’04.Berlin,Germany:Springer,2014:138-149.
[11] ZHOW Huiwei,CHEN Long,SHI Fulin,et al.Learning bilingual sentiment word embeddings for cross-language sentiment classification[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing.Washington D.C.,USA:IEEE Press,2015:430-441.
[12] ZHOU Xinjie,WAN Xiaojun,XIAO Jianguo,et al.Cross-lingual sentiment classification with bilingual document representation learning[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.Washington D.C.,USA:IEEE Press,2016:1403-1412.
[13] DAVIES A,GHAHRAMANI Z.Language-independent Bayesian sentiment mining of twitter[C]//Proceedings of the 5th SNA-KDD’11.Berlin,Germany:Springer,2011:248-259.
[14] MISHRA P,DANDA P,DHAKRAS P,et al.Code-mixed sentiment analysis using machine learning and neural network approaches[EB/OL].[2019-07-10].https://arxiv.org/abs/1808.03299.
[15] FARUQUI M,DYER C.Improving vector space word representations using multilingual correlation[C]//Proceedings of Conference of the European Chapter of the Association for Computational Linguistics.Berlin,Germany:Springer,2014:462-471.
[16] DEVLIN J,CHANG M W,LEE K,et al.BERT:pre-training of deep bidirectional transformers for language understanding[EB/OL].[2019-07-10].https://tooob.com/api/objs/read noteid/.
[17] BENDAVID E,SCHULLER T.Exploiting task relatedness for multiple task learning[C]//Proceedings of Conference on Computational Learning Theory & Kernel Machines.Washington D.C.,USA:IEEE Press,2003:635-649.
[18] VERGA P,STRUBELL E,MCCALLUM A.Simultaneously self-attending to all mentions for full-abstract biological relation extraction[EB/OL].[2019-07-10].https://arxiv.org/pdf/1802.10569.pdf.
[19] VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Proceedings of IEEE ADIPS'17.Washington D.C.,USA:IEEE Press,2017:5998-6008.
[20] HOWARD J,RUDER S.Universal language model fine-tuning for text classification[EB/OL].[2019-07-10].https://arxiv.org/pdf/1801.06146.pdf.
[21] ZHANG Xinghua,ZHANG Chunyue,SHI Huaxing,et al.Ensemble of binary classification for the emotion detection in code-switching text[C]//Proceedings of International Conference on Natural Language Processing and Chinese Computing.Berlin,Germany:Springer,2018:178-189.
[22] ZHANG Lu,WU Liangqing,LI Shoushan,et al.Cross-lingual emotion classification with auxiliary and attention neural networks[C]//Proceedings of International Conference Natural Language Processing.Hohhot,China:[s.n.],2018:429-441.
[23] WANG Tingwei,YANG Xiaohua,OUYANG Chunping,et al.A multi-emotion classification method based on BLSTM-MC in code-switching text[C]//Proceedings of International Conference Natural Language Processing.Berlin,Germany:Springer,2018:190-199.
[24] ZHANG Qirui,DONG Shoubin,ZHANG Lling.Performance evaluation in text classification[J].Journal of Guangxi Normal University(Natural Science Edition),2007,25(2):119-112.(in Chinese)张启蕊,董守斌,张凌.文本分类的性能评估指标[J].广西师范大学学报(自然科学版),2007,25(2):119-122.

选择文件类型/文献管理软件名称

选择包含的内容