Recommendation System Based on Knowledge Graph and Deep Ripple Network

doi:10.19678/j.issn.1000-3428.0065210

Abstract

Abstract: The use of Knowledge Graph（KG） and deep learning for recommendation method has been extensively studied and applied.However，most recommendation models are incomplete in terms of modeling item representation， and the high-order interaction information between users and items has not been fully captured and utilized.A Knowledge Graph Cross Ripple Network（KGCRN） is proposed for the extraction of high-order representations of user and item features，which combines the interaction information between users and items and the association information of KG.The propagation of the ripple network is used to model user preferences and item features，enriching the representation of both，and improving recommendation performance.In addition，an improved cross-compression unit is designed to process the output of the ripple network，utilizing the propagation of the ripple network and the interaction of the high-order features of the cross-compression unit to obtain accurate and comprehensive high-order representations of items，improving the accuracy of model recommendation，and enhancing the ability of the model to deal with sparse data scenarios.Experimental results on the MovieLens-20M，Book-Crossing，and Last.FM datasets show that compared to baseline methods such as KGCN，libFM，and CKE，KGCRN has significantly improved performance in scenarios： Click Through Rate（CTR） prediction，Top-K recommendation，and dealing with data sparsity. Compared to KGCN，the AUC gain in the CTR prediction experiment has increased by 0.4，5.1，and 2.4 percentage points，and the F1 value has increased by 3.29，2.86，and 0.96 percentage points.

Key words: Knowledge Graph（KG）, deep learning, ripple network, improved cross-compression unit, recommendation system

摘要： 利用知识图谱和深度学习进行推荐的方法得到了广泛的研究和应用，但是大多数推荐模型对物品表示建模不够完整，也未能全面捕捉和充分利用用户及物品的高阶交互信息。针对用户特征和物品特征高阶表示的提取问题，对用户与物品间的交互信息和知识图谱的关联信息进行联合提取，提出一种知识图谱交叉涟漪网络(KGCRN)。利用涟漪网络传播对用户偏好和物品特征进行建模，同时丰富两者的表示，提升推荐的性能。此外，设计一种改进的交叉压缩单元处理涟漪网络的输出，利用涟漪网络传播和交叉压缩单元的高阶特征交互获得准确、全面的物品高阶表示，提高模型推荐精度并增强模型应对数据稀疏场景的能力。在MovieLens-20M、Book-Crossing和Last.FM数据集上的实验结果表明，与KGCN、libFM、CKE等基线方法相比，KGCRN在点击通过率预测、Top-K推荐和应对数据稀疏场景下的性能均得到显著提升，其中，相比KGCN，点击通过率预测实验中KGCRN的AUC增益分别提高0.4、5.1、2.4个百分点，F1值分别提升3.29、2.86、0.96个百分点。

关键词: 知识图谱, 深度学习, 涟漪网络, 改进的交叉压缩单元, 推荐系统

CLC Number:

TP391

TANG Yan, LU Manxu. Recommendation System Based on Knowledge Graph and Deep Ripple Network[J]. Computer Engineering, 2023, 49(5): 63-72,80.

唐彦, 卢镘旭. 基于知识图谱与深度涟漪网络的推荐系统[J]. 计算机工程, 2023, 49(5): 63-72,80.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0065210

http://www.ecice06.com/EN/Y2023/V49/I5/63

Figures/Tables 11

References

[1] 黄立威,江碧涛,吕守业,等.基于深度学习的推荐系统研究综述[J].计算机学报,2018,41(7):1619-1647. HUANG L W,JIANG B T,LÜ S Y,et al.Survey on deep learning based recommender systems[J].Chinese Journal of Computers,2018,41(7):1619-1647.(in Chinese)
[2] WANG H W,ZHANG F Z,XIE X,et al.DKN:deep knowledge-aware network for news recommendation[C]//Proceedings of the World Wide Web Conference.New York,USA:ACM Press,2018:1835-1844.
[3] 翟丽丽,邢海龙,张树臣.基于情境聚类优化的移动电子商务协同过滤推荐研究[J].情报理论与实践,2016,39(8):106-110. ZHAI L L,XING H L,ZHANG S C.Research on mobile e-commerce collaborative filtering recommendation based on context clustering optimization[J]. Information Studies:Theory & Application,2016,39(8):106-110.(in Chinese)
[4] WANG X,WANG R J,SHI C,et al.Multi-component graph convolutional collaborative filtering[EB/OL].[2022-06-08].https://arxiv.org/abs/1911.10699v1.
[5] TAN Q Y,LIU N H,ZHAO X,et al.Learning to hash with graph neural networks for recommender systems[C]//Proceedings of the Web Conference.New York,USA:ACM Press,2020:1988-1998.
[6] LEE H,AHN Y,LEE H,et al.Quote recommendation in dialogue using deep neural network[C]//Proceedings of the 39th International Conference on Research and Development in Information Retrieval.New York,USA:ACM Press,2016:957-960.
[7] COVINGTON P,ADAMS J,SARGIN E.Deep neural networks for YouTube recommendations[C]//Proceedings of the 10th Conference on Recommender Systems.New York,USA:ACM Press,2016:191-198.
[8] DA'U A,SALIM N.Recommendation system based on deep learning methods:a systematic review and new directions[J].Artificial Intelligence Review,2020,53(4):2709-2748.
[9] ARRIETA A B,DIAZ-RODRIGUEZ N,DEL SER J,et al.Explainable Artificial Intelligence (XAI):concepts,taxonomies,opportunities and challenges toward responsible AI[J].Information Fusion,2020,58:82-115.
[10] AMINA A,MOHAMMED B.Peeking inside the black-box:a survey on Explainable Artificial Intelligence (XAI)[J].IEEE Access,2018,6:52138-52160.
[11] CAO Y X,WANG X,HE X N,et al.Unifying knowledge graph learning and recommendation:towards a better understanding of user preferences[C]//Proceedings of the World Wide Web Conference.New York,USA:ACM Press,2019:151-161.
[12] WANG X,WANG D X,XU C R,et al.Explainable reasoning over knowledge graphs for recommendation[C]//Proceedings of the AAAI Conference on Artificial Intelligence.[S.l.]:AAAI Press,2019:5329-5336.
[13] YU X,REN X,SUN Y Z,et al.Personalized entity recommendation:a heterogeneous information network approach[C]//Proceedings of the 7th International Conference on Web Search and Data Mining.New York,USA:ACM Press,2014:283-292.
[14] RENDLE S,FREUDENTHALER C,GANTNER Z,et al.BPR:Bayesian personalized ranking from implicit feedback[C]//Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence.New York,USA:ACM Press,2009:452-461.
[15] WANG H W,ZHANG F Z,WANG J L,et al.RippleNet:propagating user preferences on the knowledge graph for recommender systems[C]//Proceedings of the 27th International Conference on Information and Knowledge Management.New York,USA:ACM Press,2018:417-426.
[16] WANG X,HE X N,CAO Y X,et al.KGAT:knowledge graph attention network for recommendation[C]//Proceedings of the 25th International Conference on Knowledge Discovery & Data Mining.New York,USA:ACM Press,2019:950-958.
[17] WANG H W,ZHAO M,XIE X,et al.Knowledge graph convolutional networks for recommender systems[C]//Proceedings of the World Wide Web Conference.New York,USA:ACM Press,2019:3307-3313.
[18] WANG H W,ZHANG F Z,ZHAO M,et al.Multi-task feature learning for knowledge graph enhanced recommendation[C]//Proceedings of World Wide Web Conference.New York,USA:ACM Press,2019:13-17.
[19] HUANG J,ZHAO W X,DOU H J,et al.Improving sequential recommendation with knowledge-enhanced memory networks[C]//Proceedings of the 41st International Conference on Research and Development in Information Retrieval.New York,USA:ACM Press,2018:505-514.
[20] WANG H,WANG N Y,YEUNG D Y.Collaborative deep learning for recommender systems[C]//Proceedings of the 21th International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2015:1235-1244.
[21] WU Y,DUBOIS C,ZHENG A X,et al.Collaborative denoising auto-encoders for top-N recommender systems[C]//Proceedings of the 9th International Conference on Web Search and Data Mining.New York,USA:ACM Press,2016:153-162.
[22] LI J,REN P J,CHEN Z M,et al.Neural attentive session-based recommendation[EB/OL].[2022-06-08].https://arxiv.org/pdf/1711.04725.pdf.
[23] WANG X,HE X,WANG M,et al.Neural graph collaborative filtering[C]//Proceedings of the 42nd Annual International Conference on Research and Development in Information Retrieval.New York,USA:ACM Press,2019:165-174.
[24] HE X N,DENG K,WANG X,et al.LightGCN:simplifying and powering graph convolution network for recommendation[C]//Proceedings of the 43rd International Conference on Research and Development in Information Retrieval.New York,USA:ACM Press,2020:639-648.
[25] PEROZZI B,AL-RFOU R,SKIENA S.Deepwalk:online learning of social representations[C]//Proceedings of the 20th International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2014:701-710.
[26] GROVER A,LESKOVEC J.Node2vec:scalable feature learning for networks[EB/OL].[2022-06-08].https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5108654/pdf/nihms825755.pdf.
[27] ZHAO T,XIAO R,SUN C,et al.Personalized recommendation algorithm integrating roulette walk and combined time effect[J].Journal of Computer Applications,2014,34(4):1114-1117.
[28] PAUDEL B,BERNSTEIN A.Random walks with erasure:diversifying personalized recommendations on social and information networks[C]//Proceedings of the Web Conference.New York,USA:ACM Press,2021:2046-2057.
[29] RENDLE S.Factorization machines with libFM[J].ACM Transactions on Intelligent Systems & Technology,2012,3(3):1-22.
[30] ZHANG F Z,YUAN N J,LIAN D F,et al.Collaborative knowledge base embedding for recommender systems[C]//Proceedings of the 22nd International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2016:353-362.

Please choose a citation manager

Content to export