Multi-density Graph-based Session Recommendation Using Self-supervised Learning

doi:10.19678/j.issn.1000-3428.0066245

Abstract

Abstract:

Session-based recommendation forecasts the next item in a user's sequence of behaviors over a short period. These sessions consist of items from user feedback data. However, users typically provide feedback on only a few items, leaving many long-tail items with sparse data. Existing methods prioritize modeling sequential patterns and item relationships but neglect the long-tail aspect. This paper introduces a session-based recommendation model based on multi-task self-supervised learning. In addition to the main recommendation task, a self-supervised learning task is employed using an item frequency-based inverse sampler. This enhances learning for long-tail item embeddings, mitigating data sparsity. Additionally, to capture user intentions with greater accuracy, a multi-density session graph is constructed. This allows for the learning of session embeddings more effectively through a cohesive graph neural network. To prevent overfitting, the objective function incorporates cross-entropy with label-smoothing regularization. Experimental findings underscore the proposed algorithm's superior performance on four extensively used real-world datasets: Diginetica, Tmall, Gowalla, and Last.FM. When compared against cutting-edge baseline methods, such as the Global Context Enhanced Graph Neural Network(GCE-GNN), CO-Training framework for session-based RECommendation(COTREC), and Multi-granularity intent heterogeneous Session Graph and Intent Fusion ranking for Session-based Recommendation(MSGIFSR), the results are promising. Specifically, in the top-20 recommendation outcomes, the hit rate increases by 1.37%, 5.88%, 0.30%, and 2.16% across the datasets. Concurrently, the macro hit rate improves by 2.49%, 12.86%, 1.97%, and 10.19%, respectively.

Key words: session recommendation, Graph Neural Network(GNN), Self-Supervised Learning(SSL), multi-task learning, multi-density graph, long-tail distribution

摘要：

基于会话的推荐系统旨在根据匿名用户短时间内的历史行为序列预测下一个可能的项目，会话中的项目来自用户的反馈数据。然而，在海量的候选项目集中，用户倾向于反馈其中的小部分项目，除了少部分热门项目外，大量长尾项目的反馈数据非常稀疏。现有的会话推荐方法大多集中在对会话的序列模式以及项目之间的复杂关联关系进行建模，忽略了会话推荐中的长尾分布现象。针对这一问题，提出一种基于多任务自监督学习的会话推荐模型。在原始推荐任务基础上，使用基于项目频率的逆采样器建立自监督学习任务，以增强对长尾项目嵌入的学习，同时缓解数据稀疏性。此外，构建一个多密度会话图，并通过统一的图神经网络以可解释的方式学习会话的嵌入，以更准确地捕捉用户意图。为了避免过拟合，采用带有标签平滑正则化的交叉熵作为目标函数。实验结果表明，与GCE-GNN、COTREC、MSGIFSR等先进的基线方法相比，该方法在Diginetica、Tmall、Gowalla和Last.FM这4个真实数据集上的命中率与宏命中率显著提升，其中，在top-20推荐结果上，命中率分别提升了1.37%、5.88%、0.30%和2.16%，宏命中率分别提升了2.49%、12.86%、1.97%和10.19%。

Xiaoli LIU, Yitong WANG. Multi-density Graph-based Session Recommendation Using Self-supervised Learning[J]. Computer Engineering, 2023, 49(9): 60-68, 78.

刘晓黎, 王轶彤. 基于自监督学习的多密度图会话推荐[J]. 计算机工程, 2023, 49(9): 60-68, 78.

/ Recommend / Download Citations

URL: https://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0066245

https://www.ecice06.com/EN/Y2023/V49/I9/60

Figures/Tables 9

References 30

1	DIAS R, FONSECA M J. Improving music recommendation in session-based collaborative filtering by using temporal context[C]//Proceedings of the 25th IEEE International Conference on Tools with Artificial Intelligence. Washington D. C., USA: IEEE Press, 2014: 783-788.
2	张晓晖, 马慧芳, 王文涛, 等. 基于跨会话知识图谱的图注意力网络推荐方法. 计算机工程, 2023, 49 (2): 136-142, 149. URL
	ZHANG X H, MA H F, WANG W T, et al. Graph attention network recommendation method based on cross-session knowledge map. Computer Engineering, 2023, 49 (2): 136-142, 149. URL
3	XIA X, YIN H Z, YU J L, et al. Self-supervised hypergraph convolutional networks for session-based recommendation[EB/OL]. [2022-10-10]. https://arxiv.org/abs/2012.06852.
4	XIA X, YIN H Z, YU J L, et al. Self-supervised graph co-training for session-based recommendation[C]//Proceedings of the 30th ACM International Conference on Information & Knowledge Management. New York, USA: ACM Press, 2021: 2180-2190.
5	GUPTA P, GARG D, MALHOTRA P, et al. NISER: normalized item and session representations to handle popularity bias[EB/OL]. [2022-10-10]. https://arxiv.org/abs/1909.04276.
6	GUO J, YANG Y, SONG X, et al. Learning multi-granularity consecutive user intent unit for session-based recommendation[C]//Proceedings of the 15th ACM International Conference on Web Search and Data Mining. New York, USA: ACM Press, 2022: 343-352.
7	CHEN T W, WONG R C W. Handling information loss of graph neural networks for session-based recommendation[C]//Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM Press, 2020: 1172-1180.
8	WANG Z Y, WEI W, CONG G, et al. Global context enhanced graph neural networks for session-based recommendation[C]//Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM Press, 2020: 169-178.
9	RENDLE S, FREUDENTHALER C, SCHMIDT-THIEME L. Factorizing personalized Markov chains for next-basket recommendation[C]//Proceedings of the 19th International Conference on World Wide Web. New York, USA: ACM Press, 2010: 811-820.
10	CHEN S, MOORE J L, TURNBULL D, et al. Playlist prediction via metric embedding[C]//Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM Press, 2012: 714-722.
11	LI J, REN P J, CHEN Z M, et al. Neural attentive session-based recommendation[C]//Proceedings of 2017 ACM Conference on Information and Knowledge Management. New York, USA: ACM Press, 2017: 1419-1428.
12	WANG M R, REN P J, MEI L, et al. A collaborative session-based recommendation approach with parallel memory modules[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York, USA: ACM Press, 2019: 345-354.
13	WU S, TANG Y Y, ZHU Y Q, et al. Session-based recommendation with graph neural networks. Artificial Intelligence, 2019, 33 (1): 346- 353.
14	郑苏洋, 姜久雷, 王晓峰. 基于用户项目体验度的协同过滤推荐算法. 计算机工程, 2017, 43 (8): 215-218, 224. URL
	ZHENG S Y, JIANG J L, WANG X F. Collaborative filtering recommendation algorithm based on user project experience degree. Computer Engineering, 2017, 43 (8): 215-218, 224. URL
15	PARK Y J, TUZHILIN A. The long tail of recommender systems and how to leverage it[C]//Proceedings of 2008 ACM Conference on Recommender Systems. New York, USA: ACM Press, 2008: 11-18.
16	ZHANG Y, CHENG D Z, YAO T S, et al. A model of two tales: dual transfer learning framework for improved long-tail item recommendation[C]//Proceedings of Web Conference. New York, USA: ACM Press, 2021: 2220-2231.
17	LIU S Y, ZHENG Y J. Long-tail session-based recommendation[C]//Proceedings of the 14th ACM Conference on Recommender Systems. New York, USA: ACM Press, 2020: 509-514.
18	LARSSON G, MAIRE M, SHAKHNAROVICH G. Learning representations for automatic colorization[C]// Proceedings of European Conference on Computer Vision. Berlin, Germany: Springer, 2016: 577-593.
19	DEVLIN J, CHANG M W, LEE K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[EB/OL]. [2022-10-10]. https://arxiv.org/abs/1810.04805.
20	VELICKOVI P, FEDUS W, HAMILYON W L, et al. Deep Graph Infomax(DGI)[C]//Proceedings of IEEE International Conference on Learning Representations. Washington D. C., USA: IEEE Press, 2019: 1258-1267.
21	SUN F Y, HOFFMAN J, VERMA V, et al. Infograph: unsupervised and semi-supervised graphlevel representation learning via mutual information maximization[C]//Proceedings of IEEE International Conference on Learning Representations. Washington D. C., USA: IEEE Press, 2019: 367-378.
22	REN P J, CHEN Z M, LI J, et al. Repeatnet: a repeat aware neural recommendation machine for session-based recommendation[C]//Proceedings of AAAI Conference on Artificial Intelligence. Washington D. C., USA: IEEE Press, 2019: 4806-4813.
23	SZEGEDY C, VANHOUCKE V, IOFFE S, et al. Rethinking the inception architecture for computer vision[C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Washington D. C., USA: IEEE Press, 2016: 2818-2826.
24	SARWAR B, KARYPIS G, KONSTAN J, et al. Item-based collaborative filtering recommendation algorithms[C]//Proceedings of the 10th International Conference on World Wide Web. New York, USA: ACM Press, 2001: 285-295.
25	LIN T Y, GOYAL P, GIRSHICK R, et al. Focal loss for dense object detection[C]//Proceedings of 2017 IEEE International Conference on Computer Vision. Washington D. C., USA: IEEE Press, 2017: 2980-2988.
26	MENON A, JAYASUMANA S, RAWAT A, et al. Long-tail learning via logit adjustmen[C]//Proceedings of IEEE International Conference on Learning Representations. Washington D. C., USA: IEEE Press, 2020: 468-479.
27	BROWNLEE J. Imbalanced classification with PyThon: better metrics, balance skewed classes, cost-sensitive learning. Machine Learning, 2020, 52 (4): 269- 281.
28	KINGMA D P, BA J. Adam: a method for stochastic optimization[EB/OL]. [2022-10-10]. https://arxiv.org/abs/1412.6980.
29	WANG Y X, RAMANAN D, HEBERT M. Learning to model the tail[C]//Proceedings of NIPSʼ17. Cambridge, USA: MIT Press, 2017: 3687-3699.
30	BOX G E P, MEYER R D. An analysis for unreplicated fractional factorials. Technometrics, 1986, 28 (1): 11- 18. doi: 10.1080/00401706.1986.10488093

[1]	ZHANG Tianpeng, HAN Jing, LÜ Xueqiang. Super-Resolution-Aided Small-Target Detection Based on Multi-Task Learning [J]. Computer Engineering, 2024, 50(9): 304-312.
[2]	LI Zelin, LÜ Zhaofeng, CHEN Fuqiang, LI Ke. Entity Alignment Model Based on Multi-Hop Information Fusion [J]. Computer Engineering, 2024, 50(9): 142-152.
[3]	Xingyu HE, Yixin ZHOU, Dongxu LUO, Guisong YANG. Education Resource Recommendation Based on Graph Neural Network and Multi-Subject Rating [J]. Computer Engineering, 2024, 50(7): 13-22.
[4]	ZHANG Baoxin, YANG Dan, NIE Tiezheng, KOU Yue. Recommendation Method Based on Self-supervised Multi-view Graph Collaborative Filtering [J]. Computer Engineering, 2024, 50(5): 100-110.
[5]	YOU Ben, LI Xiaohong, YAO Jin, FENG Shaojie. Semi-supervised Classification for Short Text Based on Multi-grained Graphs and Attention Mechanism [J]. Computer Engineering, 2024, 50(5): 83-90.
[6]	SUN Wenjie, LI Zongmin, SUN Haomiao. Multi-Agent Reinforcement Learning Value Function Factorization Approach Based on Graph Neural Network [J]. Computer Engineering, 2024, 50(5): 62-70.
[7]	WANG Lin, HUANG Hao. Voice Conversion Combining Vector Quantization and CTC Introducing Pre-Trained Representation [J]. Computer Engineering, 2024, 50(4): 313-320.
[8]	Bohan WANG, Xiaoyan JIANG, Liuyi FAN. Semantic Segmentation Improvement Method Based on Deep Supervision for the Construction of Latent Space [J]. Computer Engineering, 2024, 50(3): 191-199.
[9]	Jun WANG, Huixia LAI, Yue WAN, Shi ZHANG. Angle-based Graph Neural Network Method for Anomaly Detection in High Dimensional Data [J]. Computer Engineering, 2024, 50(3): 156-165.
[10]	Haochen XU, Manhua LIU. Facial Landmark Detection Based on Hierarchical Self-Attention Network [J]. Computer Engineering, 2024, 50(2): 239-246.
[11]	GU Yuheng, PAN Jiacheng, QIAN Jiangbo, DONG Yihong. Research Progress on Graph Neural Network Classification Methods for Alzheimer's Disease [J]. Computer Engineering, 2024, 50(10): 35-50.
[12]	Jiajing GU, Dan YANG, Tiezheng NIE, Yue KOU. Recommendation Algorithm Based on Multi-view Fusion Cross-layer Contrastive Learning [J]. Computer Engineering, 2024, 50(1): 120-128.
[13]	Zhiqiang WU, Qing XIE, Lin LI, Yongjian LIU. Graph Neural Network Recommendation Algorithm Based on Multimodal Fusion [J]. Computer Engineering, 2024, 50(1): 91-100.
[14]	LI Xiaoteng, ZHANG Panpan, GOU Zhinan, GAO Kai. Multi-Modal Named Entity Recognition Method Based on Multi-Task Learning [J]. Computer Engineering, 2023, 49(4): 114-119.
[15]	LI Pan, XIE Qing, LI Lin, LIU Yongjian. Knowledge-Enhanced Graph Neural Network Model for Sequential Recommendation [J]. Computer Engineering, 2023, 49(2): 70-80.

Please choose a citation manager

Content to export