面向借贷案件的相似案例匹配模型

doi:10.19678/j.issn.1000-3428.0066055

摘要/Abstract

摘要：

相似案例匹配任务是文本匹配在司法领域的具体应用之一，目的在于区分法律文书是否相似，对类案检索具有重要意义。与传统文本匹配任务相比，法律文本通常篇幅较长，同时相似案例匹配是针对相同案由案件的匹配，案情文本之间的差异较小，以往的文本匹配方法很难计算文本相似度。针对借贷案件文本匹配存在的问题，建立一种融合借贷案件关键要素的相似案例匹配模型。为了获取文本中更丰富的语义特征，构建正则表达式获得借贷案件的特定案件要素，如借款交付形式、借款人基本属性等，并与原有的案情文本相结合，联合学习法律文本与案件关键要素的语义特征。同时，利用共享权重的预训练模型分别对不同的文书进行编码，并且对预训练模型特定编码层的输出进行融合，得到更加丰富的语义信息。引入有监督对比学习框架，更好地利用样本信息，进一步提高相似案例匹配的性能。在CAIL2019-SCM数据集上的实验结果表明，与LFESM模型相比，该模型在测试集上的准确率提高了1.05个百分点。

关键词: 相似案例匹配, 孪生网络, 对比学习, 预训练模型, 法律关键要素

Abstract:

The purpose of Similar Case Matching(SCM) is to distinguish whether legal documents are similar, which is a specific application of text matching and is vital to the retrieval of similar cases. Compared with conventional texts, legal texts are typically longer, and SCM aims to realize matching for the same case. Moreover, the difference between case texts is negligible; therefore, calculating text similarity using previous text-matching methods is challenging. This study establishes a SCM model that integrates key elements of lending cases to address the issues of text matching in lending cases. To obtain richer semantic features from texts, regular expressions are constructed to obtain specific case elements of lending cases, such as the loan-delivery form and the basic attributes of borrowers, which are then combined with the original case text to jointly learn the semantic features of the legal text and key elements of the case. Additionally, pretrained models with shared weights are used to encode different instruments separately, and the outputs of specific encoding layers of the pretrained models are fused to obtain richer semantic information. Finally, the proposed model incorporates a supervised comparison learning framework to utilize the text information more effectively and further improve the performance of SCM. Experiments on the CAIL2019-SCM dataset show that this model improves the accuracy of the test set by 1.05 percentage points compared with LFESM models.

曹发鑫, 孙媛媛, 王治政, 潘丁豪, 林鸿飞. 面向借贷案件的相似案例匹配模型[J]. 计算机工程, 2024, 50(1): 306-312.

Faxin CAO, Yuanyuan SUN, Zhizheng WANG, Dinghao PAN, Hongfei LIN. Similar Case Matching Model for Lending Cases[J]. Computer Engineering, 2024, 50(1): 306-312.

https://www.ecice06.com/CN/Y2024/V50/I1/306

图/表 6

参考文献 25

1	王景林, 吴宜霖. 类案检索制度在司法实践中的应用研究. 法制博览, 2022, (2): 100- 102.
	WANG J L, WU Y L. Research on the application of similar case retrieval system in judicial practice. Legality Vision, 2022, (2): 100- 102.
2	XIAO C J, ZHONG H X, GUO Z P, et al. CAIL2019-SCM: a dataset of similar case matching in legal domain[EB/OL]. [2022-09-16]. https://arxiv.org/abs/1911.08962.pdf.
3	CONNEAU A, KIELA D, SCHWENK H, et al. Supervised learning of universal sentence representations from natural language inference data[C]//Proceedings of 2017 Conference on Empirical Methods in Natural Language Processing. Philadelphia, USA: Association for Computational Linguistics, 2017: 670-680.
4	REIMERS N, GUREVYCH I. Sentence-BERT: sentence embeddings using Siamese BERT-networks[EB/OL]. [2022-09-16]. https://arxiv.org/abs/1908.10084.pdf.
5	DAS D, SMITH N A. Paraphrase identification as probabilistic quasi-synchronous recognition[C]//Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. Philadelphia, USA: Association for Computational Linguistics, 2009: 468-476.
6	卜质琼, 郑波尽. 基于LDA模型的Ad hoc信息检索方法研究. 计算机应用研究, 2015, 32 (5): 1369- 1372. doi: 10.3969/j.issn.1001-3695.2015.05.022
	BU Z Q, ZHENG B J. Ad hoc information retrieval method based on LDA. Application Research of Computers, 2015, 32 (5): 1369- 1372. doi: 10.3969/j.issn.1001-3695.2015.05.022
7	吕正东, 李航. 深度匹配学习在语言匹配中的应用. 中国计算机学会通讯, 2015, 8 (8): 30- 38.
	LÜ Z D, LI H. Apply deep matching learning in language matching. Communication of China Computer Federation, 2015, 8 (8): 30- 38.
8	HUANG P S, HE X D, GAO J F, et al. Learning deep structured semantic models for web search using click through data[C]//Proceedings of the 22nd ACM International Conference on Information & Knowledge Management. New York, USA: ACM Press, 2013: 2333-2338.
9	SHEN Y L, HE X D, GAO J F, et al. A latent semantic model with convolutional-pooling structure for information retrieval[C]//Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. New York, USA: ACM Press, 2014: 101-110.
10	PANG L A, LAN Y Y, GUO J F, et al. Text matching as image recognition[C]//Proceedings of AAAI Conference on Artificial Intelligence. Palo Alto, USA: AAAI Press, 2016: 2793-2799.
11	CHEN Q, ZHU X D, LING Z H, et al. Enhanced LSTM for natural language inference[EB/OL]. [2022-09-16]. https://arxiv.org/abs/1609.06038.pdf.
12	DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of 2019 Conference of the North American Chapter of Association for Computational Linguistics: Human Language Technologies, Volume 1(Long and Short Papers). Philadelphia, USA: Association for Computational Linguistics, 2019: 4171-4186.
13	VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. New York, USA: ACM Press, 2017: 6000-6010.
14	LI B H, ZHOU H, HE J X, et al. On the sentence embeddings from pre-trained language models[EB/OL]. [2022-09-16]. https://arxiv.org/abs/2011.05864.pdf.
15	SU J L, CAO J R, LIU W J, et al. Whitening sentence representations for better semantics and faster retrieval[EB/OL]. [2022-09-16]. https://arxiv.org/abs/2103.15316.pdf.
16	PEINELT N, NGUYEN D, LIAKATA M. tBERT: topic models and BERT joining forces for semantic similarity detection[C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: Association for Computational Linguistics, 2020: 7047-7055.
17	GAO T Y, YAO X C, CHEN D Q. SimCSE: simple contrastive learning of sentence embeddings[EB/OL]. [2022-09-16]. https://arxiv.org/abs/2104.08821.pdf.
18	JAWAHAR G, SAGOT B, SEDDAH D. What does BERT learn about the structure of language?[C]//Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: Association for Computational Linguistics, 2019: 3651-3657.
19	LIU Y H, OTT M, GOYAL N, et al. RoBERTa: a robustly optimized BERT pretraining approach[EB/OL]. [2022-09-16]. https://arxiv.org/abs/1907.11692.pdf.
20	PALANGI H, DENG L, SHEN Y L, et al. Deep sentence embedding using long short-term memory networks: analysis and application to information retrieval. ACM Transactions on Audio, Speech, and Language Processing, 2016, 24 (4): 694- 707. doi: 10.1109/TASLP.2016.2520371
21	HU B T, LU Z D, LI H, et al. Convolutional neural network architectures for matching natural language sentences[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems. New York, USA: ACM Press, 2014: 2042-2050.
22	SU J L, LU Y, PAN S F, et al. RoFormer: enhanced Transformer with rotary position embedding[EB/OL]. [2022-09-16]. https://arxiv.org/abs/2104.09864.pdf.
23	DING S Y, SHANG J Y, WANG S H, et al. ERNIE-doc: a retrospective long-document modeling Transformer[EB/OL]. [2022-09-16]. https://arxiv.org/abs/2012.15688.pdf.
24	HONG Z L, ZHOU Q F, ZHANG R, et al. Legal feature enhanced semantic matching network for similar case matching[C]//Proceedings of 2020 International Joint Conference on Neural Networks. Washington D. C., USA: IEEE Press, 2020: 1-8.
25	PENNINGTON J, SOCHER R, MANNING C. GloVe: global vectors for word representation[C]//Proceedings of 2014 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: Association for Computational Linguistics, 2014: 1532-1543.

[1]	魏嵬, 丁香香, 郭梦星, 杨钊, 刘辉. 文本相似度计算方法综述[J]. 计算机工程, 2024, 50(9): 18-32.
[2]	高爽, 史轶伦, 徐巧枝, 于磊. 基于对比学习的非对称编解码结构的心脏MRI分割研究[J]. 计算机工程, 2024, 50(8): 290-300.
[3]	钱来, 赵卫伟. 基于对比学习和注意力机制的文本分类方法[J]. 计算机工程, 2024, 50(7): 104-111.
[4]	刘娟, 段友祥, 陆誉翕, 张鲁. 引入知识增强和对比学习的知识图谱补全[J]. 计算机工程, 2024, 50(7): 112-122.
[5]	武星, 殷浩宇, 姚骏峰, 李卫民, 钱权. 面向视频数据的多模态情感分析[J]. 计算机工程, 2024, 50(6): 218-227.
[6]	周昭辰, 方清茂, 吴晓红, 胡平, 何小海. 基于MacBERT与对抗训练的机器阅读理解模型[J]. 计算机工程, 2024, 50(5): 41-50.
[7]	张宝鑫, 杨丹, 聂铁铮, 寇月. 基于自监督的多视角图协同过滤推荐方法[J]. 计算机工程, 2024, 50(5): 100-110.
[8]	李田芳, 普园媛, 赵征鹏, 徐丹, 钱文华. 基于CLIP和双空间自适应归一化的图像翻译[J]. 计算机工程, 2024, 50(5): 229-240.
[9]	张洪程, 李林育, 杨莉, 伞晨峻, 尹春林, 颜冰, 于虹, 张璇. 基于对比学习与语言模型增强嵌入的知识图谱补全[J]. 计算机工程, 2024, 50(4): 168-176.
[10]	李政学, 李枝名, 彭德中, 陈杰. 基于特征对比学习和图卷积的社交网络用户分类[J]. 计算机工程, 2024, 50(4): 258-266.
[11]	侯钰涛, 阿布都克力木·阿布力孜, 史亚庆, 马依拉木·木斯得克, 哈里旦木·阿布都克里木. 面向"一带一路"的低资源语言机器翻译研究[J]. 计算机工程, 2024, 50(4): 332-341.
[12]	吴冠荣, 李元祥, 王艺霖, 陆雨寒, 陈秀华. 基于对比学习的小样本金属表面损伤分类[J]. 计算机工程, 2024, 50(3): 36-43.
[13]	于明诚, 党亚固, 吴奇林, 吉旭, 毕可鑫. 基于多尺度上下文的英文作文自动评分研究[J]. 计算机工程, 2024, 50(3): 259-266.
[14]	孙仁科, 许靖昊, 皇甫志宇, 李仲年, 许新征. 基于视觉-语言预训练模型的零样本迁移学习方法综述[J]. 计算机工程, 2024, 50(10): 1-15.
[15]	吴永庆, 王钰涵, 朱月. 基于用户多类型反馈行为序列的点击率预估模型[J]. 计算机工程, 2024, 50(10): 405-417.

选择文件类型/文献管理软件名称

选择包含的内容