Phrase Mining in Ecommerce Based on Cooperative Training

doi:10.19678/j.issn.1000-3428.0054276

Abstract

Abstract: The texts in ecommerce usually do not follow the way of expression as the texts in general domains,resulting in low accuracy of traditional phrase mining methods in the ecommerce text mining.Therefore,this paper proposes a phrase mining method based on cooperative training.Through the phrase classification model based on semantic features,the antitone expression of ecommerce texts is effectively detected.Then the phrase mining framework of cooperative training is constructed,so as to reducing the cost of marking training data in the domain corpus.On this basis,the Stacking method is used to integrate the advantages of statistical model and semantic model,thus improving the overall mining performance of the model.Experimental results on Taobao query corpus show that compared with ClassPhrase and AutoPhrase methods,the proposed method has higher accuracy and recall rate.

Key words: ensemble learning, phrase mining, cooperative training, deep learning, Named Entity Recognition(NER)

摘要： 电商领域的文本通常不遵循通用领域文本的表达方式，导致传统短语挖掘方法在电商领域文本中的挖掘精度较低。为此，提出一种基于协同训练的电商领域短语挖掘方法。通过基于语义特征的短语分类模型来有效检测电商领域文本中的反序表达，构建协同训练的短语挖掘框架，以降低领域语料中标注训练数据的成本，在此基础上，利用Stacking方法集成统计模型和语义模型的优点，提升模型整体挖掘性能。在淘宝网查询语料上的实验结果表明，相比于ClassPhrase、AutoPhrase方法，该方法具有更高的精度和召回率。

关键词: 集成学习, 短语挖掘, 协同训练, 深度学习, 命名实体识别

CLC Number:

TP391

XU Yong, LIU Jingping, XIAO Yanghua, ZHU Muhua. Phrase Mining in Ecommerce Based on Cooperative Training[J]. Computer Engineering, 2020, 46(4): 70-76,84.

许勇, 刘井平, 肖仰华, 朱慕华. 基于协同训练的电商领域短语挖掘[J]. 计算机工程, 2020, 46(4): 70-76,84.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0054276

http://www.ecice06.com/EN/Y2020/V46/I4/70

Figures/Tables 8

References 25

[1]	LIU Jialu,SHANG Jingbo,WANG Chi,et al.Mining quality phrases from massive text corpora[C]//Proceedings of ACM SIGMOD International Conference on Management of Data.New York,USA:ACM Press,2015:1729-1744.
[2]	YU Qinqin,PENG Dunlu,LIU Cong.Extracting feature phrases from large-scale word sequences based on frequent word sets[J].Journal of Chinese Computer Systems,2018,39(5):1027-1032.(in Chinese) 余琴琴,彭敦陆,刘丛.大规模词序列中基于频繁词集的特征短语抽取模型[J].小型微型计算机系统,2018,39(5):1027-1032.
[3]	CAO Huanhuan,JIANG Daxin.Context-aware query suggestion by mining click-through and session data[C]//Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2008:15-22.
[4]	RIZVI S,MENDELZON A O,SUDARSHAN S,et al.Extending query rewriting techniques for fine-grained access control[C]//Proceedings of 2004 ACM SIGMOD International Conference on Management of Data.New York,USA:ACM Press,2004:15-26.
[5]	KAGEURA K,UMINO B.Methods of automatic term recognition:a review[J].Terminology International Journal of Theoretical and Applied Issues in Specialized Communication,1996,3(2):259-289.
[6]	MATSUO Y,ISHIZUKA M.Keyword extraction from a single document using word co-occurrence statistical information[J].International Journal on Artificial Intelligence Tools,2004,13(1):157-169.
[7]	FRANTZI K,ANANIADOU S,MIMA H.Automatic recognition of multi-word terms:the C-value/NC-value method[J].International Journal on Digital Libraries,2000,3(2):115-130.
[8]	PARK Y,BYRD R J,BOGURAEV B K.Automatic glossary extraction:beyond terminology identification[C]//Proceedings of the 19th International Conference on Computational Linguistics.Washington D.C.,USA:IEEE Press,2002:56-78.
[9]	XUN Endong,HUANG Changning,ZHOU Ming,et al.A unified statistical model for the identification of English baseNP[C]//Proceedings of the 38th Annual Meeting on Association for Computational Linguistics.[S.l.]:Association for Computational Linguistics,2000:23-36.
[10]	CHENG Wenliang,ZHANG Min.Simple semi-supervised dependency parsing[C]//Proceedings of ACL.[S.l.]:ACL,2008:25-36.
[11]	DEANE P.A nonparametric method for extraction of candidate phrasal terms[C]//Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics.Washington D.C.,USA:IEEE Press,2005:25-30.
[12]	NADEAU D,SEKINE S.A survey of named entity recognition and classification[J].Lingvisticae Investigationes,2007,30(1):3-26.
[13]	GONG Y,LUO X,ZHU K Q,et al.Automatic generation of Chinese short product titles for mobile display[EB/OL].[2019-02-25].https://arxiv.org/pdf/1803.11359.pdf.
[14]	HOCHREITER S,SCHMIDHUBER J.Long short-term memory[J].Neural Computation,1997,9(8):1735-1780.
[15]	BLUM A,MITCHELL T.Combining labeled and unlabeled data with Co-training[C]//Proceedings of the 11th Annual Conference on Computational Learning Theory.New York,USA:ACM Press,1998:92-100.
[16]	WOLPERT D H.Stacked generalization[J].Neural Networks.1992,5(2):241-259.
[17]	ZHANG Xiaoming,WANG Zhijun,LIANG Liping.A Stacking algorithm for convolution neural network[J].Computer Engineering,2018,44(4):243-247.(in Chinese) 张笑铭,王志君,梁利平.一种适用于卷积神经网络的Stacking算法[J].计算机工程,2018,44(4):243-247.
[18]	CHEN K H,CHEN H H.Extracting noun phrases from large-scale texts:a hybrid approach and its automatic evaluation[C]//Proceedings of the 32nd Annual Meeting on Association for Computational Linguistics.[S.l.]:Association for Computational Linguistics,1994:22-36.
[19]	PARAMESWARAN A G,GARCIA-MOLINA H,RAJARAMAN A.Towards the Web of concepts:extracting concepts from large datasets[J].Proceedings of the VLDB Endowment,2010,3(1):566-577.
[20]	EL-KISHKY A,SONG Y,WANG C,et al.Scalable topical phrase mining from text corpora[J].Proceedings of the VLDB Endowment,2014,8(3):305-316.
[21]	SHANG J,LIU J,JIANG M,et al.Automated phrase mining from massive text corpora[J].IEEE Transactions on Knowledge and Data Engineering,2018,30(10):1825-1837.
[22]	LI X L,YU P S,LIU B,et al.Positive unlabeled learning for data stream classification[C]//Proceedings of 2009 SIAM International Conference on Data Mining.Washington D.C.,USA:IEEE Press,2009:12-35.
[23]	WANG Wei,ZHOU Zhihua.Analyzing Co-Training style algorithms[EB/OL].[2019-02-20].https://cs.nju.edu.cn/_upload/tpl/01/0b/267/template267/zhouzh.files/publication/ecml07a.pdf.
[24]	CHURCH K W,HANKS P.Word association norms,mutual information,and lexicography[J].Computational Linguistics,2002,16(1):22-29.
[25]	HO T K.Random decision forests[C]//Proceedings of the 3rd International Conference on Document Analysis and Recognition.Washington D.C.,USA:IEEE Press,1995:589-594.

Please choose a citation manager

Content to export