Knowledge-Enhanced Graph Neural Network Model for Sequential Recommendation

doi:10.19678/j.issn.1000-3428.0063844

Abstract

Abstract: Existing sequential recommendation models based on the Graph Neural Network (GNN) focus on the structural information of users' interaction with items, and the learning of sequence preference involves the sequence of interactive items, which lack content information and user information, and does not mine a deep semantic relationship between items.A knowledge-enhanced GNN sequence recommendation model(KGGNN) is proposed.First, a knowledge graph is introduced and combined with users' interaction data to construct a collaborative knowledge graph, which can obtain the relevant auxiliary information of items and users.By transforming an interaction sequence into a directed sequence graph, the algorithm uses the Gated Graph Neural Network (GGNN) and relevant auxiliary information of the users to learn the structural information of the item node in the sequence.The model combines the vectors of the items as the global sequence preference using the attention mechanism, and the recently interactive item is considered as the current interest preference.The two preferences are fused to form the final sequence preference, which is used with the semantic relevant auxiliary information of the current item to predict the next item.The experimental results of Amazon Book, Last FM, and Yelp 2018 indicate that the auxiliary information can effectively help improve the accuracy of the hit rate(HIT@K) and normalized discounted cumulative gain(NDCG@K) metrics.Compared with GRU4Rec, NARM, SASRec, and other models, the aforementioned indicators have significantly improved.When the K value of the evaluation index is 10, compared with the KGSR model, HIT@10 is improved by 12.9%, 4.5%, and 6.9%, and NDCG@10 is improved by 29.4%, 5.7%, and 16.7%.

Key words: sequential recommendation, Graph Neural Network(GNN), Knowledge Graph(KG), recommendation system, user behavior, deep learning

摘要： 现有基于图神经网络的序列推荐模型大多仅关注用户与项目交互的结构性信息，序列偏好的学习仅涉及项目交互顺序，缺乏项目自身的内容信息，并且未有效利用用户信息及挖掘项目之间更深层的语义关系。提出一种知识增强的图神经网络序列推荐模型KGGNN，引入知识图谱，并结合用户交互数据构建协同知识图谱，学习得到项目语义关联辅助信息以及用户关联辅助信息。将交互序列构建成有向序列图，利用门控图神经网络以及用户关联辅助信息学习序列中项目节点的结构性信息。通过注意力机制组合项目向量作为全局序列偏好，将最近交互的项目作为当前兴趣偏好，融合两者形成最终序列偏好，并结合项目语义关联辅助信息进行模型预测。在Amazon-Book、Last-FM、Yelp2018这3个公开数据集上的实验结果表明，辅助信息能有效提升序列推荐的准确性，该模型在命中率（HIT@K）和归一化折损累计增益（NDCG@K）2个指标上相较于GRU4Rec、NARM、SASRec等模型均有显著提升。当评估指标K值选取10时，与KGSR模型相比，其HIT@10指标在3个数据集上分别提升12.9%、4.5%、6.9%，NDCG@10指标在3个数据集上分别提升29.4%、5.7%、16.7%。

CLC Number:

TP391

LI Pan, XIE Qing, LI Lin, LIU Yongjian. Knowledge-Enhanced Graph Neural Network Model for Sequential Recommendation[J]. Computer Engineering, 2023, 49(2): 70-80.

李盼, 解庆, 李琳, 刘永坚. 知识增强的图神经网络序列推荐模型[J]. 计算机工程, 2023, 49(2): 70-80.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0063844

http://www.ecice06.com/EN/Y2023/V49/I2/70

Figures/Tables 9

References

[1] WANG S J, HU L, WANG Y, et al.Sequential recommender systems:challenges, progress and prospects[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.New York, USA:ACM Press, 2019:6332-6338.
[2] 黄立威, 江碧涛, 吕守业, 等.基于深度学习的推荐系统研究综述[J].计算机学报, 2018, 41(7):1619-1647. HUANG L W, JIANG B T, LÜ S Y, et al.Survey on deep learning based recommender systems[J].Chinese Journal of Computers, 2018, 41(7):1619-1647.(in Chinese)
[3] HIDASI B, KARATZOGLOU A, BALTRUNAS L, et al.Session-based recommendations with recurrent neural networks[EB/OL].[2021-12-10].https://arxiv.org/abs/1511.06939.
[4] TAN Y K, XU X X, LIU Y.Improved recurrent neural networks for session-based recommendations[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems.New York, USA:ACM Press, 2016:17-22.
[5] LI J, REN P J, CHEN Z M, et al.Neural attentive session-based recommendation[C]//Proceedings of 2017 Conference on Information and Knowledge Management.New York, USA:ACM Press, 2017:1419-1428.
[6] TANG J X, WANG K.Personalized top-N sequential recommendation via convolutional sequence embedding[C]//Proceedings of the 11th International Conference on Web Search and Data Mining.New York, USA:ACM Press, 2018:565-573.
[7] YUAN F J, KARATZOGLOU A, ARAPAKIS I, et al.A simple convolutional generative network for next item recommendation[C]//Proceedings of the 12th International Conference on Web Search and Data Mining.New York, USA:ACM Press, 2019:582-590.
[8] WU S, TANG Y Y, ZHU Y Q, et al.Session-based recommendation with graph neural networks[C]//Proceedings of the AAAI Conference on Artificial Intelligence.Palo Alto, USA:AAAI Press, 2019:346-353.
[9] XU C F, ZHAO P P, LIU Y C, et al.Graph contextualized self-attention network for session-based recommendation[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence.New York, USA:ACM Press, 2019:3940-3946.
[10] 胡承佐, 王庆梅, 李迪超, 等.基于复杂结构信息的图神经网络序列推荐算法[J].计算机工程, 2022, 48(5):82-90, 97. HU C Z, WANG Q M, LI D C, et al.Sequence recommendation algorithm of graph neural networks based on complex structure information[J].Computer Engineering, 2022, 48(5):82-90, 97.(in Chinese)
[11] WU S, SUN F, ZHANG W, et al.Graph neural networks in recommender systems:a survey[EB/OL].[2021-12-10].https://arxiv.org/abs/2011.02260v4.
[12] YING R, HE R N, CHEN K F, et al.Graph convolutional neural networks for web-scale recommender systems[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York, USA:ACM Press, 2018:974-983.
[13] HE X N, DENG K, WANG X, et al.LightGCN:simplifying and powering graph convolution network for recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2020:639-648.
[14] YU F, ZHU Y Q, LIU Q, et al.TAGNN:target attentive graph neural networks for session-based recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval.New York, USA:ACM Press, 2020:1921-1924.
[15] 吴玺煜, 陈启买, 刘海, 等.基于知识图谱表示学习的协同过滤推荐算法[J].计算机工程, 2018, 44(2):226-232, 263. WU X Y, CHEN Q M, LIU H, et al.Collaborative filtering recommendation algorithm based on representation learning of knowledge graph[J].Computer Engineering, 2018, 44(2):226-232, 263.(in Chinese)
[16] WANG X, WANG D X, XU C R, et al.Explainable reasoning over knowledge graphs for recommendation[C]//Proceedings of AAAI Conference on Artificial Intelligence.Palo Alto, USA:AAAI Press, 2019:5329-5336.
[17] WANG H W, ZHAO M, XIE X, et al.Knowledge graph convolutional networks for recommender systems[C]//Proceedings of the 19th World Wide Web Conference.New York, USA:ACM Press, 2019:3307-3313.
[18] WANG X, HE X N, CAO Y X, et al.KGAT:knowledge graph attention network for recommendation[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.New York, USA:ACM Press, 2019:950-958.
[19] 沈冬东, 汪海涛, 姜瑛, 等.一种融合知识图谱与长短期偏好的下一项推荐算法[J].小型微型计算机系统, 2020, 41(4):849-854. SHEN D D, WANG H T, JIANG Y, et al.Next recommendation algorithm that fuses knowledge graph with long-term and short-term preferences[J].Journal of Chinese Computer Systems, 2020, 41(4):849-854.(in Chinese)
[20] WANG Q, XIONG Y, ZHU Y, et al.KASR:knowledge-aware sequential recommendation[C]//Proceedings of Asia-Pacific Web and Web-Age Information Management Joint International Conference on Web and Big Data.Berlin, Germany:Springer, 2020:493-508.
[21] ZHU X, ZHAO P, XU J, et al.Knowledge graph attention network enhanced sequential recommendation[C]//Proceedings of Asia-Pacific Web and Web-Age Information Management Joint International Conference on Web and Big Data.Berlin, Germany:Springer, 2020:181-195.
[22] LIN Y K, LIU Z Y, SUN M S, et al.Learning entity and relation embeddings for knowledge graph completion[C]//Proceedings of AAAI Conference on Artificial Intelligence, Palo Alto, USA:AAAI Press, 2015:2181-2187.
[23] LI Y J, TARLOW D, BROCKSCHMIDT M, et al.Gated graph sequence neural networks[EB/OL].[2021-12-10].https://arxiv.org/abs/1511.05493.
[24] ZHANG M Q, WU S, GAO M, et al.Personalized graph neural networks with attention mechanism for session-aware recommendation[J].IEEE Transactions on Knowledge and Data Engineering, 2022, 34(8):3946-3957.
[25] KANG W C, MCAULEY J.Self-attentive sequential recommendation[C]//Proceedings of IEEE International Conference on Data Mining.Washington D.C., USA:IEEE Press, 2018:197-206.
[26] HE X, LIAO L, ZHANG H, et al.Neural collaborative filtering[C]//Proceedings of the 26th International Conference on World Wide Web.New York, USA:ACM Press, 2017:173-182.

Please choose a citation manager

Content to export