融入事件实体知识的汉越跨语言新闻事件检索

doi:10.19678/j.issn.1000-3428.0061596

摘要/Abstract

摘要： 现有汉越跨语言新闻事件检索方法较少使用新闻领域内的事件实体知识，在候选文档中存在多个事件的情况下，与查询句无关的事件会干扰查询句与候选文档间的匹配精度，影响检索性能。提出一种融入事件实体知识的汉越跨语言新闻事件检索模型。通过查询翻译方法将汉语事件查询句翻译为越南语事件查询句，把跨语言新闻事件检索问题转化为单语新闻事件检索问题。考虑到查询句中只有单个事件，候选文档中多个事件共存会影响查询句和文档的精准匹配，利用事件触发词划分候选文档事件范围，减小文档中与查询无关事件的干扰。在此基础上，利用知识图谱和事件触发词得到事件实体丰富的知识表示，通过查询句与文档事件范围间的交互，提取到事件实体知识表示与词以及事件实体知识表示之间的排序特征。在汉越双语新闻数据集上的实验结果表明，与BM25、Conv-KNRM、ATER等基线模型相比，该模型能够取得较好的跨语言新闻事件检索效果，NDCG和MAP指标最高可提升0.712 2和0.587 2。

关键词: 跨语言检索, 事件实体, 事件触发词, 事件范围, 排序学习, 事件检索

Abstract: The existing Chinese-Vietnamese cross-language news event retrieval methods are not sufficiently integrated into the knowledge of event entities in the news field.Furthermore, when there are multiple events in the candidate document, events unrelated to the query sentence interfere with the matching accuracy between the query sentence and the candidate documents, which affects retrieval performance.This study proposes a Chinese-Vietnamese cross-language news event retrieval model incorporating event entity knowledge.The query translation method is used to translate Chinese event query sentences into Vietnamese event query sentences, and the cross-language news event retrieval problem is transformed into a monolingual news event retrieval problem.Considering that there is only a single event in the query sentence, the coexistence of multiple events in the candidate document affects the exact match between the query sentence and the document.The event trigger word is used to divide the event range of the candidate document and to reduce the interference of events unrelated to the query in the document.On this basis, the knowledge graph and event trigger words are used to obtain the rich knowledge representation of event entities.Through the interaction between the query sentence and the document event scope, the ranking features between the knowledge representation of event entities and the knowledge representation of words and event entities are extracted.The experimental results on the Chinese-Vietnamese bilingual news dataset show that compared with baseline models such as BM25, Conv-KNRM, and ATER, the proposed model achieves better cross-language news event retrieval performance;furthermore, using the proposed model, the NDCG and MAP indicators can be improved by up to 0.712 2 and 0.587 2.

Key words: cross-language retrieval, event entity, event trigger, event range, ranking learning, event retrieval

中图分类号:

TP18

薛振宇, 余正涛, 高盛祥. 融入事件实体知识的汉越跨语言新闻事件检索[J]. 计算机工程, 2022, 48(8): 274-282,291.

XUE Zhenyu, YU Zhengtao, GAO Shengxiang. Chinese-Vietnamese Cross-Language News Event Retrieval Incorporating Event Entity Knowledge[J]. Computer Engineering, 2022, 48(8): 274-282,291.

http://www.ecice06.com/CN/Y2022/V48/I8/274

图/表 6

20220825094658

20220825094701

20220825094705

20220825094708

20220825094712

20220825094717

参考文献

[1] GIANG L T, HUNG V T, PHAP H C, et al.Building structured query in target language for Vietnamese-English cross language information retrieval systems[J].International Journal of Engineering Research and Technolgy, 2015, 4(4):146-151.
[2] ELAYEB B, BOUNHAS I.Arabic cross-language information retrieval:a review[J].ACM Transactions on Asian and Low-Resource Language Information Processing, 2016, 15(3):1-44.
[3] RAHIMI R, MONTAZERALGHAEM A, SHAKERY A.An axiomatic approach to corpus-based cross-language information retrieval[J].Information Retrieval Journal, 2020, 23(3):191-215.
[4] PASSALIS N, TEFAS A.Entropy optimized feature-based bag-of-words representation for information retrieval[J].IEEE Transactions on Knowledge and Data Engineering, 2016, 28(7):1664-1677.
[5] YAN R, SONG Y, WU H.Learning to respond with deep neural networks for retrieval-based human-computer conversation system[C]//Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2016:55-64.
[6] XIONG C Y, CALLAN J, LIU T Y.Bag-of-entities representation for ranking[C]//Proceedings of 2016 ACM International Conference on the Theory of Information Retrieval.New York, USA:ACM Press, 2016:181-184.
[7] DALTON J, DIETZ L, ALLAN J.Entity query feature expansion using knowledge base links[C]//Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2014:365-374.
[8] LIU X T, FANG H.Latent entity space:a novel retrieval approach for entity-bearing queries[J].Information Retrieval Journal, 2015, 18(6):473-503.
[9] ENSAN F, BAGHERI E.Document retrieval model through semantic linking[C]//Proceedings of the 10th ACM International Conference on Web Search and Data Mining.New York, USA:ACM Press, 2017:181-190.
[10] SHEN Y L, HE X D, GAO J F, et al.A latent semantic model with convolutional-pooling structure for information retrieval[C]//Proceedings of the 23rd ACM International Conference on Information and Knowledge Management.New York, USA:ACM Press, 2014:101-110.
[11] DAI Z Y, XIONG C Y, CALLAN J, et al.Convolutional neural networks for soft-matching N-grams in ad-hoc search[C]//Proceedings of the 11th ACM International Conference on Web Search and Data Mining.New York, USA:ACM Press, 2018:126-134.
[12] 薛振宇, 线岩团, 余正涛, 等.融合词典与对抗迁移的越南语事件实体识别[J].计算机工程, 2022, 48(3):107-114, 145. XUE Z Y, XIAN Y T, YU Z T, et al.Vietnamese event entity recognition combining dictionary and adversarial transfer[J].Computer Engineering, 2022, 48(3):107-114, 145.(in Chinese)
[13] ZHANG S, RUDINGER R, VAN DURME B.An evaluation of PredPatt and Open IE via stage 1 semantic role labeling[C]//Proceedings of the 12th International Conference on Computational Semantics.Washington D.C., USA:IEEE Press, 2017:1-5.
[14] RODOSTHENOUS C, LYDING V, SANGATI F, et al.Using crowdsourced exercises for vocabulary training to expand conceptnet[C]//Proceedings of the 12th Language Resources and Evaluation Conference.Marseille, France:European Language Resources Association, 2020:307-316.
[15] ZHANG Y, JIN R, ZHOU Z H.Understanding bag-of-words model:a statistical framework[J].International Journal of Machine Learning and Cybernetics, 2010, 1(1/2/3/4):43-52.
[16] 陈鑫, 李伟康, 洪宇, 等.面向问句复述识别的多卷积自交互匹配方法研究[J].中文信息学报, 2019, 33(10):99-108, 118. CHEN X, LI W K, HONG Y, et al.A multi-convolution self-interaction method for question paraphrase identification[J].Journal of Chinese Information Processing, 2019, 33(10):99-108, 118.(in Chinese)
[17] XIONG C Y, CALLAN J, LIU T Y.Word-entity duet representations for document ranking[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2017:763-772.
[18] KADHIM A I.Term weighting for feature extraction on Twitter:a comparison between BM25 and TF-IDF[C]//Proceedings of International Conference on Advanced Science and Engineering.Washington D.C., USA:IEEE Press, 2019:124-128.
[19] KIM S W, GIL J M.Research paper classification systems based on TF-IDF and LDA schemes[J].Human-Centric Computing and Information Sciences, 2019, 9(1):1-21.
[20] CAO S, LU W, ZHOU J, et al.cw2vec:learning Chinese word embeddings with stroke n-gram information[C]//Proceedings of the AAAI Conference on Artificial Intelligence.[S.l.]:AAAI Press, 2018:5053-5061.
[21] HOFSTÄTTER S, REKABSAZ N, EICKHOFF C, et al.On the effect of low-frequency terms on neural-IR models[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2019:1137-1140.
[22] SUN Y F.A comparative evaluation of string similarity metrics for ontology alignment[J].Journal of Information and Computational Science, 2015, 12(3):957-964.
[23] 杨晋吉, 胡波, 王欣明, 等.一种知识图谱的排序学习个性化推荐算法[J].小型微型计算机系统, 2018, 39(11):2419-2423. YANG J J, HU B, WANG X M, et al.Personalized recommendation algorithm for learning to rank by knowledge graph[J].Journal of Chinese Computer Systems, 2018, 39(11):2419-2423.(in Chinese)
[24] RAZZAK I, KHAN T M.One-class support tensor machines with bounded hinge loss function for anomaly detection[C]//Proceedings of International Joint Conference on Neural Networks.Washinton D.C., USA:IEEE Press, 2020:1-8.
[25] JIN X B, GENG G G, XIE G S, et al.Approximately optimizing NDCG using pair-wise loss[J].Information Sciences, 2018, 453:50-65.
[26] GROS D, HABERMANN T, KIRSTEIN G, et al.Anaphora resolution:analysing the impact on mean average precision and detecting limitations of automated approaches[J].International Journal of Information Retrieval Research, 2018, 8(3):33-45.
[27] PENG L, LU G Q.Research on query term expansion based on RankSVM and LDA model[J].Journal of Physics:Conference Series, 2020, 1684(1):1-10.
[28] SAYED M F, OARD D W.Jointly modeling relevance and sensitivity for search among sensitive content[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2019:615-624.
[29] HU B, LU Z, LI H, et al.Convolutional neural network architectures for matching natural language sentences[C]//Proceedigns of NIPS'14.Montreal, Canada:Neural Information Processing Systems Foundation, 2014:2042-2050.
[30] TANG Z L, LI J.Jointly considering Siamese network and MatchPyramid network for text semantic matching[J].IOP Conference Series:Materials Science and Engineering, 2019, 490:1-10.
[31] GUO J F, FAN Y X, AI Q Y, et al.A deep relevance matching model for ad-hoc retrieval[C]//Proceedings of the 25th ACM International Conference on Information and Knowledge Management.New York, USA:ACM Press, 2016:55-64.
[32] XIONG C Y, DAI Z Y, CALLAN J, et al.End-to-end neural ad-hoc ranking with kernel pooling[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2017:55-64.
[33] 曹旭友, 周志平, 王利, 等.基于BERT+ATT和DBSCAN的长三角专利匹配算法[J].信息技术, 2020, 44(3):1-5, 12. CAO X Y, ZHOU Z P, WANG L, et al.Yangtze River delta patent matching algorithm based on BERT+ATT and DBSCAN[J].Information Technology, 2020, 44(3):1-5, 12.(in Chinese)
[34] 胡澔.基于BERT的神经排序模型研究[D].武汉:华中师范大学, 2020. HU H.Research on BERT-based neural ranking models[D].Wuhan:Central China Normal University, 2020.(in Chinese)
[35] 周艳平, 李金鹏, 宋群豹.一种基于SVM及文本密度特征的网页信息提取方法[J].计算机应用与软件, 2019, 36(10):251-255, 261. ZHOU Y P, LI J P, SONG Q B.A Web page information extraction method based on SVM and text density features[J].Computer Applications and Software, 2019, 36(10):251-255, 261.(in Chinese)
[36] DEVLIN J, CHANG M W, LEE K, et al.BERT:pre-training of deep bidirectional transformers for language understanding[EB/OL].[2021-06-10].https://arxiv.org/abs/1810.04805.

选择文件类型/文献管理软件名称

选择包含的内容