基于机器阅读理解模型与众包验证的属性值抽取方法

doi:10.19678/j.issn.1000-3428.0057666

摘要/Abstract

摘要： 由于互联网语料的高噪音特性，传统的属性值抽取方法存在人工成本增加及训练集缺乏等问题。提出一种新的实体属性值抽取方法。利用机器阅读理解模型，从互联网语料中抽取出高质量的候选属性值，通过高效的众包验证机制调整各候选属性值的权重，得到最终抽取结果。实验结果表明，与OpenTag、QANET等模型相比，该机器阅读理解模型有效提升了候选属性值抽取的准确性，抽取准确率提升10%左右，同时通过众包验证方法，能够以较低的众包成本提高属性值抽取的整体性能。

关键词: 属性值抽取, 机器阅读理解模型, 知识图谱, 众包, 序列标注

Abstract: Due to the high noise characteristics of Internet corpus,traditional extraction methods based on attribute values suffer from increased labor costs and lack of training sets.This paper proposes an entity attribute value extraction method based on machine reading comprehension model and crowdsourcing verification.The new machine reading comprehension model is used to extract high-quality candidate attribute values from the Internet corpus,and the weight of each candidate attribute value is adjusted through an efficient crowdsourcing verification mechanism to obtain the final extraction result.Experimental results show that compared with OpenTag,QANET and other models,the machine reading comprehension model effectively improves the accuracy of candidate attribute value extraction,and the extraction accuracy is increased by about 10%.At the same time,it can improve the overall performance of attribute value extraction at a low crowdsourcing cost by using crowdsourcing verification.

Key words: attribute value extraction, machine reading comprehension model, knowledge graph, crowdsourcing, sequence labeling

中图分类号:

TP18

冯桫, 刘井平, 蒋海云, 肖仰华. 基于机器阅读理解模型与众包验证的属性值抽取方法[J]. 计算机工程, 2021, 47(5): 97-103.

FENG Suo, LIU Jingping, JIANG Haiyun, XIAO Yanghua. Attribute Value Extraction Method Based on Machine Reading Comprehension Model and Crowdsourcing Verification[J]. Computer Engineering, 2021, 47(5): 97-103.

http://www.ecice06.com/CN/Y2021/V47/I5/97

参考文献

[1] WU Xiyu,CHEN Qimai,LIU Hai,et al.Collaborative filtering recommendation algorithm based on representation learning of knowledge graph[J].Computer Engineering,2018,44(2):226-232,263.(in Chinese)吴玺煜,陈启买,刘海,等.基于知识图谱表示学习的协同过滤推荐算法[J].计算机工程,2018,44(2):226-232,263.
[2] DENG Yang,XIE Yuexiang,LI Yaliang,et al.Multi-task learning with multi-view attention for answer selection and knowledge base question answering[EB/OL].[2020-02-08].https://arxiv.org/abs/1812.02354.
[3] CHEN Jiangjie,WANG Ao,JIANG Haiyun,et al.Ensuring readability and data-fidelity using head-modifier templates in deep type description generation[EB/OL].[2020-02-08].https://arxiv.org/abs/1905.12198.
[4] AUER S,BIZER C,KOBILAROV G,et al.Dbpedia:a nucleus for a Web of open data[C]//Proceedings of the 6th International Semantic Web Conference.Berlin,Germany:Springer,2007:722-735.
[5] REBELE T,SUCHANEK F,HOFFART J,et al.YAGO:a multilingual knowledge base from wikipedia,wordnet,and geonames[C]//Proceedings of the 15th International Semantic Web Conference.Berlin,Germany:Springer,2016:177-185.
[6] XU Bo,XU Yong,LIANG Jiaqing,et al.CN-DBpedia:a never-ending Chinese knowledge extraction system[C]//Proceedings of International Conference on Industrial,Engineering and Other Applications of Applied Intelligent Systems.Berlin,Germany:Springer,2017:428-438.
[7] HWARST M A.Automatic acquisition of hyponyms from large text corpora[C]//Proceedings of the 14th Conference on Computational Linguistics.Stroudsburg,USA:ACL,1992:539-545.
[8] CHEN Jindong,WANG Ao,CHEN Jiangjie,et al.CN-Probase:a data-driven approach for large-scale Chinese taxonomy construction[C]//Proceedings of the 35th International Conference on Data Engineering.Washington D.C.,USA:IEEE Press,2019:1706-1709.
[9] JIANG Xiaotian,WANG Quan,LI Peng,et al.Relation extraction with multi-instance multi-label convolutional neural networks[C]//Proceedings of the 26th International Conference on Computational Linguistics:Technical Papers.Stroudsburg,USA:ACL,2016:1471-1480.
[10] MINTZ M,BILLS S,SNOW R,et al.Distant supervision for relation extraction without labeled data[C]//Proceedings of Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP.Stroudsburg,USA:ACL,2009:1003-1011.
[11] ZHANG Yingcheng,YANG Yang,JIANG Rui,et al.Commercial intelligence entity recognition model based on BiLSTM-CRF[J].Computer Engineering,2019,45(5):308-314.(in Chinese)张应成,杨洋,蒋瑞,等.基于BiLSTM-CRF的商情实体识别模型[J].计算机工程,2019,45(5):308-314.
[12] MIWA M,BANSAL M.End-to-end relation extraction using LSTMs on sequences and tree structures[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics.Stroudsburg,USA:ACL,2016:1105-1116.
[13] ZHENG G,MUKHERJEE S,DONG X L,et al.Opentag:open attribute value extraction from product profiles[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York,USA:ACM Press,2018:1049-1058.
[14] YU A W,DOHAN D,LUONG M T,et al.Qanet:combining local convolution with global self-attention for reading comprehension[EB/OL].[2020-02-08].https://openreview.net/forum?id=B14TlG-RW.
[15] SEO M,KEMBHAVI A,FARHADI A,et al.Bidirectional attention flow for machine comprehension[EB/OL].[2020-02-08].https://openreview.net/forum?id=HJ0UKP9ge.
[16] MIKOLOV T,SUTSKEVER I,CHEN K,et al.Distributed representations of words and phrases and their compositionality[C]//Proceedings of NIPS'13.New York,USA:ACM Press,2013:3111-3119.
[17] PENNINGTON J,SOCHER R,MANNING C D.GloVe:Global vectors for word representation[C]//Proceedings of 2014 Conference on Empirical Methods in Natural Language Processing.Stroudsburg,USA:ACL,2014:1532-1543.
[18] DEVLIN J,CHANG M W,LEE K,et al.BERT:pre-training of deep bidirectional transformers for language under-standing[C]//Proceedings of 2019 Conference of the 9th American Chapter of the Association for Computational Linguistics:Human Language Technologies.Stroudsburg,USA:ACL,2019:4171-4186.
[19] VASWANI A,SHAZEER N,PARMAR N,et al.Attention is all you need[C]//Proceedings of NIPS'13.New York,USA:ACM Press,2017:5998-6008.
[20] KAISER L,GOMEZ A N,CHOLLET F.Depthwise separable convolutions for neural machine translation[EB/OL].[2020-02-08].https://openreview.net/forum?id=S1jBcueAb.
[21] BA J L,KIROS J R,HINTON G E.Layer normalization[EB/OL].[2020-02-28].https://arxiv.org/abs/1607.06450.
[22] KONDREDDI S K,TRIANTAFILLOU P,WEIKUM G.HIGGINS:knowledge acquisition meets the crowds[C]//Proceedings of the 22nd International Conference on World Wide Web.New York,USA:ACM Press,2013:85-86.
[23] LI Qi,JIANG Meng,ZHANG Xikun,et al.Truepie:discovering reliable patterns in pattern-based information extraction[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York,USA:ACM Press,2018:1675-1684.
[24] LI Peng,LI Wei,HE Zhengyan,et al.Dataset and neural recurrent sequence labeling model for open-domain factoid question answering[EB/OL].[2020-02-08].https://arxiv.org/pdf/1607.06275.pdf.

选择文件类型/文献管理软件名称

选择包含的内容