基于多粒度字形增强的中文医学命名实体识别

doi:10.19678/j.issn.1000-3428.0067285

计算机工程 ›› 2024, Vol. 50 ›› Issue (2): 337-344. doi: 10.19678/j.issn.1000-3428.0067285

基于多粒度字形增强的中文医学命名实体识别

刘威¹, 马磊¹^,*(), 李凯², 李蓉³

1. 昆明理工大学信息工程与自动化学院, 云南昆明 650500
2. 云南省第一人民医院信息科, 云南昆明 650500
3. 云南省第一人民医院科研科, 云南昆明 650500

收稿日期:2023-03-27 出版日期:2024-02-15 发布日期:2023-07-04
通讯作者: 马磊
基金资助:
国家自然科学基金(62266025); 云南省重大科技专项计划项目(202202AD080004); 云南省重大科技专项计划项目(202202AE090008); 云南省基础研究计划（昆医联合专项）(202201AY070001-258)

Chinese Medical Named Entity Recognition Based on Multi-Granularity Glyph Enhancement

Wei LIU¹, Lei MA¹^,*(), Kai LI², Rong LI³

1. Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, Yunnan, China
2. Information Department of the First People's Hospital of Yunnan Province, Kunming 650500, Yunnan, China
3. Scientific Research Department of the First People's Hospital of Yunnan Province, Kunming 650500, Yunnan, China

Received:2023-03-27 Online:2024-02-15 Published:2023-07-04
Contact: Lei MA

摘要/Abstract

摘要：

中文医学命名实体识别（CMNER）旨在从中文非结构化医学文本中提取实体。现有的基于字符的CMNER模型没有从不同角度全面考虑汉字的特点，限制了其应用于CMNER的性能。基于此，提出基于多粒度字形增强的中文医学命名实体识别模型。对于输入的句子，结合汉字的字形空间结构和偏旁部首的表示，同时根据相应的领域词典来匹配字符的领域词信息，增强字符的语义和潜在边界信息，使模型获得更好的实体识别能力；通过门控机制整合领域词和汉字的字形多粒度特征，综合考虑汉字的领域信息和汉字底层信息，从而具有更好的感知医学实体的能力。在此基础上，将多粒度字形增强的字符表示输入到双向长短记忆和条件随机场层，分别进行上下文编码和标签解码。实验结果表明，本文模型较于最佳基线模型在IMCS21和CMeEE数据集上的F1值分别提升了1.04%和0.62%。此外，通过消融实验验证了该模型的每个组成部分的有效性，在识别中文医学命名实体时具有较好的识别性能。

关键词: 命名实体识别, 医学领域, 字形结构, 门控机制, 领域词典

Abstract:

Chinese Medical Named Entity Recognition(CMNER) focuses on extracting entities from unstructured Chinese medical texts. Current character-based CMNER models inadequately address the distinct features of Chinese characters from various angles, thereby limiting their efficacy in CMNER applications. To address this, a model leveraging multigranular glyph information enhancement for Chinese medical named entity recognition is introduced. This model integrates the glyph spatial structure and radical representation of Chinese characters, aligning them with domain-specific lexicon-based word information. This approach enriches the semantic and boundary potential of characters. Through a gating mechanism, the model effectively combines domain-specific terms with the multifaceted glyph features of Chinese characters, ensuring comprehensive consideration of both domain relevance and intrinsic character details, thereby enhancing its capacity for medical entity recognition. The model employs multigranular glyph-enhanced character representations in the Bidirectional Long Short-Term Memory(BiLSTM) and Conditional Random Field(CRF) layers for contextual encoding and label decoding, respectively. Experimental results demonstrate that the proposed model surpasses the best baseline model, achieving an increase in F1 scores of 1.04% and 0.62% on the IMCS21 and CMeEE datasets, respectively. Ablation studies further confirm the efficacy of each component, highlighting the model's superiority in recognizing Chinese medical named entities.

Key words: named entity recognition, medical domain, glyph structure, gating mechanism, domain lexicon

刘威, 马磊, 李凯, 李蓉. 基于多粒度字形增强的中文医学命名实体识别[J]. 计算机工程, 2024, 50(2): 337-344.

Wei LIU, Lei MA, Kai LI, Rong LI. Chinese Medical Named Entity Recognition Based on Multi-Granularity Glyph Enhancement[J]. Computer Engineering, 2024, 50(2): 337-344.

https://www.ecice06.com/CN/Y2024/V50/I2/337

图/表 7

参考文献 26

1	CHEN C, KONG F. Enhancing entity boundary detection for better Chinese named entity recognition[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Stroudsburg, USA: Association for Computational Linguistics, 2021: 20-25.
2	ZHANG Y, YANG J. Chinese NER using lattice LSTM[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: Association for Computational Linguistics, 2018: 1554-1564.
3	MA R T, PENG M L, ZHANG Q, et al. Simplify the usage of lexicon in Chinese NER[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: Association for Computational Linguistics, 2020: 5951-5960.
4	TANG B, CAO H, WU Y, et al. Recognizing clinical entities in hospital discharge summaries using structural support vector machines with word representation features. BMC Medical Informatics & Decision Making, 2013, 13 (S1): 1- 10. doi: 10.1186/1472-6947-13-S1-S1
5	LIU K X, HU Q C, LIU J W, et al. Named entity recognition in Chinese electronic medical records based on CRF[C]//Proceedings of the 14th Web Information Systems and Applications Conference. Washington D. C., USA: IEEE Press, 2017: 325-337.
6	LEI J B, TANG B Z, LU X Q, et al. A comprehensive study of named entity recognition in Chinese clinical text. Journal of the American Medical Informatics Association, 2014, 21 (5): 808- 814. doi: 10.1136/amiajnl-2013-002381
7	XU Y, WANG Y N, LIU T R, et al. Joint segmentation and named entity recognition using dual decomposition in Chinese discharge summaries. Journal of the American Medical Informatics Association, 2014, 21 (1): 84- 92. URL
8	HE L N, YANG Z H, LIN H F, et al. Drug name recognition in biomedical texts: a machine-learning-based method. Drug Discovery Today, 2014, 19 (5): 610- 617. doi: 10.1016/j.drudis.2013.10.006
9	YAO L, MAO C S, LUO Y. Clinical text classification with rule-based features and knowledge-guided convolutional neural networks. BMC Medical Informatics and Decision Making, 2019, 19 (3): 71. doi: 10.1186/s12911-019-0781-4
10	LI Y B, WANG X H, HUI L H, et al. Chinese clinical named entity recognition in electronic medical records: development of a lattice long short-term memory model with contextualized character representations. JMIR Medical Informatics, 2020, 8 (9): 198- 208. URL
11	CHEN Y, ZHOU C J, LI T X, et al. Named entity recognition from Chinese adverse drug event reports with lexical feature based BiLSTM-CRF and tri-training. Journal of Biomedical Informatics, 2019, 96, 103252. doi: 10.1016/j.jbi.2019.103252
12	LUO L, YANG Z H, YANG P, et al. An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition. Bioinformatics, 2018, 34 (8): 1381- 1388. doi: 10.1093/bioinformatics/btx761
13	LAMPLE G, BALLESTEROS M, SUBRAMANIAN S, et al. Neural architectures for named entity recognition[C]//Proceedings of NAACL'16. Washington D. C., USA: IEEE Press, 2016: 260-270.
14	XU K, ZHOU Z F, HAO T Y, et al. A bidirectional LSTM and conditional random fields approach to medical named entity recognition[C]//Proceedings of International Conference on Advanced Intelligent Systems and Informatics. Berlin, Germany: Springer, 2017: 355-365.
15	LI X Y, ZHANG H, ZHOU X H. Chinese clinical named entity recognition with variant neural structures based on BERT methods. Journal of Biomedical Informatics, 2020, 107, 103422. doi: 10.1016/j.jbi.2020.103422
16	ZHANG M Y, WANG J, ZHANG X J. Using a pre-trained language model for medical named entity extraction in Chinese clinic text[C]//Proceedings of the 10th IEEE International Conference on Electronics Information and Emergency Communication. Washington D. C., USA: IEEE Press, 2020: 312-317.
17	SHARMA R, MORWAL S, AGARWAL B, et al. A deep neural network-based model for named entity recognition for Hindi language. Neural Computing and Applications, 2020, 32 (20): 16191- 16203. URL
18	MENG Y, WU W, WANG F, et al. Glyce: glyph-vectors for Chinese character representations[C]//Proceedings of ANIPS'19. Cambridge, USA: MIT Press, 2019: 3824-3833.
19	GUO X C, LU S H, TANG Z, et al. CG-ANER: enhanced contextual embeddings and glyph features-based agricultural named entity recognition. Computers and Electronics in Agriculture, 2022, 194, 106776.
20	HUANG Z, XU W, YU K. Bidirectional ISTM-CRF[EB/OL]. [2023-02-20]. https://arxiv.org/abs/1508.01991.pdf.
21	LIU W, XU T, XU Q, et al. An encoding strategy based word-character lstm for Chinese NER[J]//Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics. Washington D. C., USA: IEEE Press, 2019: 2379-2389.
22	STRUBELL E, VERGA P. Fast and accurate entity recognition with iterated dilated convolutions[EB/OL]. [2023-02-20]. https://arxiv.org/abs/1702.02098.pdf.
23	GUI T, MA R, ZHANG Q, et al. CNN-based Chinese NER with lexicon rethinking[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence. Washington D. C., USA: IEEE Press, 2019: 4982-4988.
24	GUI T, ZOU Y C, ZHANG Q, et al. A lexicon-based graph neural network for Chinese NER[C]//Processing and the 9th International Joint Conference on Natural Language Processing. Washington D. C., USA: IEEE Press, 2019: 1040-1050.
25	LI X N, YAN H, QIU X P, et al. FLAT: Chinese NER using flat-lattice Transformer[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: Association for Computational Linguistics, 2020: 531-544.
26	WU S, SONG X, FENG Z. MECT: multi-metadata embedding based cross-transformer for Chinese named entity recognition[EB/OL]. [2023-02-20]. https://arxiv.org/abs/2107.05418.pdf.

[1]	党小超, 刘涧, 董晓辉, 祝忠彦, 李芬芳. 面向不平衡数据的机械设备故障命名实体识别[J]. 计算机工程, 2024, 50(9): 104-112.
[2]	张华青, 夏张涛, 陆晓庆, 童基均. 基于字形特征的血管外科命名实体识别[J]. 计算机工程, 2024, 50(8): 13-21.
[3]	李华昱, 张智康, 闫阳, 岳阳. 基于知识图谱增强的领域多模态实体识别[J]. 计算机工程, 2024, 50(8): 31-39.
[4]	隗昊, 刁宏悦, 孔亮宸, 邓耀臣. 东北亚舆情文本细粒度命名实体识别方法研究[J]. 计算机工程, 2024, 50(5): 354-362.
[5]	隗昊, 刁宏悦, 孔亮宸, 邓耀臣. 东北亚舆情文本细粒度命名实体识别方法研究[J]. 计算机工程, 2024, 50(5): 354-362.
[6]	夏卫欢, 廖列法, 张守信, 张燕琴. 基于方面-词性感知的方面级情感分析[J]. 计算机工程, 2024, 50(3): 68-77.
[7]	任义, 苏博, 袁帅. 教育领域下多维度特征命名实体识别方法[J]. 计算机工程, 2024, 50(10): 110-118.
[8]	唐卓然, 柳毅. 基于词汇融合和依存关系的中文命名实体识别[J]. 计算机工程, 2024, 50(10): 145-153.
[9]	杨长沛, 廖列法. 基于门控空洞卷积特征融合的中文命名实体识别[J]. 计算机工程, 2023, 49(8): 85-95.
[10]	郭艳霞, 金勇, 唐宏, 彭金枝. 基于动态卷积与残差门控的多模态情感识别[J]. 计算机工程, 2023, 49(7): 94-101.
[11]	张家熔, 苑津莎, 许珈宁, 罗志宏. 基于多元信息嵌入与协同神经网络的力学实体识别算法[J]. 计算机工程, 2023, 49(7): 125-134.
[12]	陈明, 刘蓉, 张晔. 基于多重注意力机制的中文医疗实体识别[J]. 计算机工程, 2023, 49(6): 314-320.
[13]	朱红, 牛浩然, 朱彤. 基于字词融合与对抗训练的行业人物实体识别[J]. 计算机工程, 2023, 49(5): 56-62.
[14]	毛亮, 赵林均, 余敦辉, 孙斌. 基于知识蒸馏的企业命名实体识别模型[J]. 计算机工程, 2023, 49(5): 90-96.
[15]	李晓腾, 张盼盼, 勾智楠, 高凯. 基于多任务学习的多模态命名实体识别方法[J]. 计算机工程, 2023, 49(4): 114-119.

选择文件类型/文献管理软件名称

选择包含的内容

基于多粒度字形增强的中文医学命名实体识别

Chinese Medical Named Entity Recognition Based on Multi-Granularity Glyph Enhancement

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 7

参考文献 26

相关文章 15

编辑推荐

Metrics

本文评价

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

基于多粒度字形增强的中文医学命名实体识别

Chinese Medical Named Entity Recognition Based on Multi-Granularity Glyph Enhancement

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 7

参考文献 26

相关文章 15

编辑推荐

Metrics

本文评价