作者投稿和查稿 主编审稿 专家审稿 编委审稿 远程编辑

计算机工程 ›› 2023, Vol. 49 ›› Issue (9): 52-59. doi: 10.19678/j.issn.1000-3428.0065745

• 人工智能与模式识别 • 上一篇    下一篇

基于关系学习网络的小样本知识图谱补全模型

冉丈杰1,2, 孙林夫1,2, 邹益胜1,2, 马玉麟1,2   

  1. 1. 西南交通大学 计算机与人工智能学院, 成都 611031
    2. 西南交通大学 制造业产业链协同与信息化支撑技术四川省重点实验室, 成都 611031
  • 收稿日期:2022-09-14 出版日期:2023-09-15 发布日期:2023-01-03
  • 作者简介:

    冉丈杰(1996—),男,硕士研究生,主研方向为知识图谱、自然语言处理、产业链协同

    孙林夫,教授、博士

    邹益胜,副教授、博士

    马玉麟,博士研究生

  • 基金资助:
    四川省科技计划项目(2021YFG0040)

Few-Shot Knowledge Graph Completion Model Based on Relation Learning Network

Zhangjie RAN1,2, Linfu SUN1,2, Yisheng ZOU1,2, Yulin MA1,2   

  1. 1. School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611031, China
    2. Manufacturing Industry Chains Collaboration and Information Support Technology Key Laboratory of Sichuan Province, Southwest Jiaotong University, Chengdu 611031, China
  • Received:2022-09-14 Online:2023-09-15 Published:2023-01-03

摘要:

现实世界中的知识图谱由大量事实三元组构成,其中通常包含许多出现次数很少的小样本关系,面向这些小样本关系补全知识图谱中缺失的三元组是一项具有挑战性的工作。针对现有小样本知识图谱补全模型中普遍存在的小样本关系表示无法有效提取问题,提出一种基于关系学习网络的小样本知识图谱补全模型。考虑关系的相关性,对参考和查询三元组进行邻域聚合编码,获得增强的实体嵌入表示。基于融合Transformer编码器与长短期记忆神经网络的结构,将三元组的关系表示进行编码输出。利用注意力机制得出查询关系与动态参考关系的语义相似性,并结合平移模型的假设对查询三元组成立的可能性进行综合打分。实验结果表明,该模型通过融合路径发现与上下文语义有效提取了小样本关系的细粒度语义,在小样本链接预测任务中,相较于基线模型中评价指标的最优值平均提升了9.5个百分点。

关键词: 小样本关系, 邻域聚合, 关系表示, 知识图谱补全, 链接预测

Abstract:

A Knowledge Graph(KG) is composed of a large number of fact triples, which often contain a large number of few-shot relations that rarely appear in the real world. For these few-shot relations, it is challenging to complete the missing triples in the KG, and existing few-shot Knowledge Graph Completion(KGC) models cannot effectively extract the representation of few-shot relations. To address this problem, a few-shot KGC model based on a relation learning network is proposed. Considering the relevance of the relations, neighbor aggregation encoding is performed on the reference and query triples to obtain an enhanced entity embedding representation. The structure that integrates a Transformer encoder and Long Short-Term Memory(LSTM) neural network, allows the relation representation of triples to be encoded and output. The semantic similarity between query and dynamic reference relations is obtained using the attention mechanism and combined with the hypothesis of the translation model, whereby the possibility of establishing query triples is comprehensively scored. The experimental results show that the model can effectively extract the fine-grained semantics of few-shot relations by integrating path-finding and context semantics. Compared with the optimal value of the evaluation metrics in baseline models, the average improvement of few-shot link prediction tasks reach 9.5 percentage points with the proposed model.

Key words: few-shot relation, neighbor aggregation, relation representation, Knowledge Graph Completion(KGC), link prediction