Method for Extracting Event Trigger Words Based on the CNN-BiGRU Model

doi:10.19678/j.issn.1000-3428.0058756

Abstract

Abstract: The existing methods for extracting event trigger words rely heavily on manual intervention and natural language processing tools for feature extraction, leading to frequent error propagation and high data sparsity.To address the problem, a new method for extracting event trigger words is proposed based on the CNN-BiGRU model.Taking the word vectors and position vectors as the input, the model can extract both word-level features and global sentence features, which improves the result of trigger word extraction.In addition, the model employs Convolutional Neural Network(CNN) to extract word-level features, and BiGRU to obtain the contextual semantic information of the text. The experimental results show that the F1 value of the model in event trigger word recognition reaches 74.9% on the ACE2005 English corpus and 79.29% on the Chinese Emergency Corpus(CEC), indicating that the proposed model can improve the performance of event trigger word extraction.

Key words: event extraction, trigger word detection, event type recognition, Convolutional Neural Network(CNN), Recurrent Neural Network(RNN), Bidirectional Gated Recurrent Unit(BiGRU), feature extraction

摘要： 传统事件触发词抽取方法在特征提取过程中对自然语言处理工具产生过度依赖的方法，耗费大量人力，容易出现错误传播和数据稀疏性等问题。为此，提出采用CNN-BiGRU模型进行事件触发词抽取的方法。将词向量和位置向量进行拼接作为输入，提取词级别特征和句子全局特征，提高触发词抽取效果，并通过CNN提取词汇级别特征，利用BiGRU获取文本上下文语义信息。在ACE2005英文语料库和中文突发事件语料库CEC上的实验结果表明，该模型事件触发词识别F1值分别达到74.9%和79.29%，有效提升事件触发词的抽取性能。

关键词: 事件抽取, 触发词检测, 事件类型识别, 卷积神经网络, 循环神经网络, 双向门控循环单元, 特征提取

CLC Number:

TP18

MIAO Jia, DUAN Yuexing, ZHANG Yueqin, ZHANG Zehua. Method for Extracting Event Trigger Words Based on the CNN-BiGRU Model[J]. Computer Engineering, 2021, 47(9): 69-74,83.

苗佳, 段跃兴, 张月琴, 张泽华. 基于CNN-BiGRU模型的事件触发词抽取方法[J]. 计算机工程, 2021, 47(9): 69-74,83.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0058756

http://www.ecice06.com/EN/Y2021/V47/I9/69

Figures/Tables 11

References

[1] 朱木易洁, 鲍秉坤, 徐常胜.知识图谱发展与构建的研究进展[J].南京信息工程大学学报(自然科学版), 2017, 9(6):575-582. ZHU M Y J, BAO B K, XU C S.Research progress on the development and construction of knowledge graph[J].Journal of Nanjing University of Information Science & Technology(Natural Science Edition), 2017, 9(6):575-582.(in Chinese)
[2] 高李政, 周刚, 罗军勇, 等.元事件抽取研究综述[J].计算机科学, 2019, 46(8):9-15. GAO L Z, ZHOU G, LUO J Y, et al.Review of research on meta-event extraction[J].Computer Science, 2019, 46(8):9-15.(in Chinese)
[3] 孙佩佩, 廖涛, 刘宗田.基于事件要素的自动文摘抽取[J].计算机与数字工程, 2015, 43(10):1829-1833. SUN P P, LIAO T, LIU Z T.Automatic abstract extraction based on event arguments[J].Computer and Digital Engineering, 2015, 43(10):1829-1833.(in Chinese)
[4] AHN D.The stages of event extraction[C]//Proceedings of Workshop on Annotating and Reasoning About Time and Events.Cambridge, USA:MIT Press, 2006:1-8.
[5] 漆桂林, 高桓, 吴天星.知识图谱研究进展[J].情报工程, 2017, 3(1):4-25. QI G L, GAO H, WU T X.Research progress of knowledge graph[J].Journal of Information Engineering, 2017, 3(1):4-25.(in Chinese)
[6] 郑巧夺, 吴贞东, 邹俊颖.基于双层CNN-BiGRU-CRF模型的事件因果关系抽取方法[J].计算机工程, 2021, 47(5):58-64, 72. ZHENG Q D, WU Z D, ZOU J Y.Event causality extraction method based on two-layer CNN-BiGRU-CRF model[J].Computer Engineering, 2021, 47(5):58-64, 72.(in Chinese)
[7] LIAO S, GRISHMAN R.Using document level cross-event inference to improve event extraction[C]//Proceedings of the 48th Annual Meetings of the Association for Computational Linguistics.Cambridge, USA:MIT Press, 2010:789-797.
[8] HONG Y, ZHANG J, MA B, et al.Using cross-entity inference to improve event extraction[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:Human Language Technologies.Cambridge, USA:MIT Press, 2011:1127-1136.
[9] LI Q, JI H, HUANG L.Joint event extraction via structured prediction with global features[C]//Proceedings of Meeting of the Association for Computational Linguistics.Cambridge, USA:MIT Press, 2013:73-82.
[10] NGUYEN T H, GRISHMAN R.Event detection and domain adaptation with convolutional neural network[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing.Stroudsburg, USA:ACL Press, 2015:365-371.
[11] CHEN Y, XU L, LIU K, et al.Event extraction via dynamic multi-pooling convolutional neural networks[C]//Proceedings of Meeting of the Association for Computational Linguistics.Cambridge, USA:MIT Press, 2015:167-176.
[12] NGUYEN T H, CHO K, GRISHMAN R.Joint event extraction via recurrent neural networks[C]//Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies.Cambridge, USA:MIT Press, 2016:300-309.
[13] 陈斌, 周勇, 刘兵.基于卷积长短期记忆网络的事件触发词抽取[J].计算机工程, 2019, 45(1):153-158. CHEN B, ZHOU Y, LIU B.Event trigger extraction based on convolutional bidirectional long short term memory network[J].Computer Engineering, 2019, 45(1):153-158.(in Chinese)
[14] LIU S L, CHEN Y B, LIU K, et al.Exploiting argument information to improve event detection via supervised attention mechanisms[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics.Stroudsburg, USA:ACL Press, 2017:1789-1798.
[15] 王丽亚, 刘昌辉, 蔡敦波, 等.CNN-BiGRU网络中引入注意力机制的中文文本情感分析[J].计算机应用, 2019, 39(10):2841-2846. WANG L Y, LIU C H, CAI D B, et al.Sentiment analysis of Chinese text with attention mechanism introduced in CNN-BiGRU network[J].Computer Applications, 2019, 39(10):2841-2846.(in Chinese)
[16] 柳亦婷, 李培峰.基于局部实体特征的事件触发词抽取[J].计算机工程, 2019, 45(11):213-217, 224. LIU Y T, LI P F.Event trigger word extraction based on local entity features[J].Computer Engineering, 2019, 45(11):213-217, 224.(in Chinese)
[17] 吴文涛, 李培峰, 朱巧明.基于混合神经网络的实体和事件联合抽取方法[J].中文信息学报, 2019, 33(8):77-83. WU W T, LI P F, ZHU Q M.A joint extraction method of entities and events based on hybrid neural network[J].Journal of Chinese Information Processing, 2019, 33(8):77-83.(in Chinese)
[18] 易士翔, 尹宏鹏, 郑恒毅.基于BiLSTM的公共安全事件触发词识别[J].工程科学学报, 2019, 41(9):1201-1207. YI S X, YIN H P, ZHENG H Y.Public safety event trigger word recognition based on BiLSTM[J].Journal of Engineering Science, 2019, 41(9):1201-1207.(in Chinese)
[19] ZHANG Z, XU W, CHEN Q.Joint event extraction based on skip-window convolutional neural networks[C]//Proceedings of International Conference on Computer Processing of Oriental Languages.Berlin, Germany:Springer, 2016:324-334.
[20] PYYSALO S, OHTA T, MIWA M, et al.Event extraction across multiple levels of biological organization[J].Bioinformatics, 2012, 28(18):575-586.
[21] ZHOU D Y, ZHONG D Y, HE Y L.Event trigger identification for biomedical events extraction using domain knowledge[J].Bioinformatics, 2014, 30(11):1587.
[22] WANG J, LI H L, AN Y, et al.Biomedical event trigger detection based on convolutional neural network[J].International Journal of Data Mining and Bioinformatics, 2016, 15(3):195.

Please choose a citation manager

Content to export