基于变分自编码器的混合推荐算法

doi:10.19678/j.issn.1000-3428.0056245

摘要/Abstract

摘要： 较多传统推荐算法因未考虑曝光因素而难以解决冷启动问题。为此，通过引入曝光隐变量，提出一种基于变分自编码器的混合推荐算法。在协同过滤背景下使用马尔科夫链蒙特卡洛采样推断曝光隐变量和特征向量，在推断过程中将前一次迭代得到的分布结果作为先验，利用共轭关系直接得到参数后验，以提高推断精度。在此基础上，通过变分自编码器VAEe抽取用户曝光向量的隐特征，据此对该用户做曝光预测，同时训练变分自编码器VAEi抽取商品的协同隐特征，解决新商品的冷启动问题。在真实数据集上的实验结果表明，该算法能够同时提高旧商品和新商品的推荐性能。

Abstract: Most of the traditional recommendation algorithms fail to effectively solve the cold start problem for they do not consider the exposure factor.To this end,this paper introduces the exposure hidden variable and proposes a hybrid recommendation algorithm based on Variational Auto-Encoder(VAE).In the context of collaborative filtering,the algorithm uses Markov Chain Monte Carlo(MCMC) sampling to make the inference of the exposure hidden variable and feature vectors.In the inference process,the distribution result obtained from the previous iteration is used as a priori,and the conjugate relationship is used to directly obtain the posteriori of parameters to improve the inference accuracy.On this basis,the VAEe is used to extract the hidden features of the user’s exposure vector,so as to make the exposure prediction for the user,and the VAEi is trained to extract the collaborative hidden features of the product,so as to solve the cold start problem of the new product.Experimental results on the real world dataset show that the proposed algorithm improves the recommending performance of the old products and new products at the same time.

Key words: recommendation algorithm, Variational Auto-Encoder(VAE), Markov Chain Monte Carlo(MCMC) sampling, collaborative filtering, deep learning

中图分类号:

TP18

张宇生, 张桂珠, 王晓锋. 基于变分自编码器的混合推荐算法[J]. 计算机工程, 2020, 46(12): 96-104.

ZHANG Yusheng, ZHANG Guizhu, WANG Xiaofeng. Hybrid Recommendation Algorithm Based on Variational Auto-Encoder[J]. Computer Engineering, 2020, 46(12): 96-104.

http://www.ecice06.com/CN/Y2020/V46/I12/96

图/表 5

20201216140836

20201216140840

20201216140843

20201216140846

20201216140849

参考文献

[1] YANG Bo,ZHAO Pengfei.Review of the art of recommenda-tion algorithms[J].Journal of Shanxi University(Natural Science Edition),2011,34(3):6-19.(in Chinese)杨博,赵鹏飞.推荐算法综述[J].山西大学学报(自然科学版),2011,34(3):6-19.
[2] LENG Yajun,LU Qing,LIANG Changyong.Survey of recommendation based on collaborative filtering[J].Pattern Recognition and Artificial Intelligence,2014,27(8):720-734.(in Chinese)冷亚军,陆青,梁昌勇.协同过滤推荐技术综述[J].模式识别与人工智能,2014,27(8):720-734.
[3] SUN Yanrui,CHEN Yue.Hybrid recommendation algorithm based on Timed-HITS and collaborative filtering[J].Journal of Northeastern University(Natural Science),2019,40(4):14-19,24.(in Chinese)孙艳蕊,陈月.基于Timed-HITS与协同过滤的混合推荐算法[J].东北大学学报(自然科学版),2019,40(4):14-19,24.
[4] LEI Kai,LIU Shubo,LI Dan,et al.Content-based POI recommendation in real-time traffic constraint[J].Computer Engineering,2017,43(10):147-152.(in Chinese)雷凯,刘树波,李丹,等.实时路况制约下基于内容的兴趣点推荐[J].计算机工程,2017,43(10):147-152.
[5] KOREN Y.Factorization meets the neighborhood:a multifaceted collaborative filtering model[C]//Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2008:426-434.
[6] KOREN Y.Collaborative filtering with temporal dynamics[J].Communications of the ACM,2010,53(4):89-97.
[7] CHEN Tianqi,ZHENG Zhao,LU Qiuxia,et al.Feature-based matrix factorization[EB/OL].[2019-09-11].https://arxiv.org/pdf/1109.2271.pdf.
[8] SALAKHUTDINOV R,MNIH A.Probabilistic matrix factorization[C]//Proceedings of International Conference on Neural Information Processing Systems.New York,USA:ACM Press,2007:1257-1264.
[9] SALAKHUTDINOV R,MNIH A.Bayesian probabilistic matrix factorization using Markov chain Monte Carlo[C]//Proceedings of International Conference on Machine Learning.New York,USA:ACM Press,2008:880-887.
[10] LEBANON G.Local low-rank matrix approximation[C]//Proceedings of the 30th International Conference on Machine Learning.Atlanta,USA:JMLR,2013:82-90.
[11] LI Mengmeng,XIA Yang,LI Xinru,et al.Dynamic hybrid recommendation algorithm based on stacked denoising autoencoder[J].Computer Engineering,2019,45(8):184-189.(in Chinese)李梦梦,夏阳,李心茹,等.基于栈式降噪自动编码器的动态混合推荐算法[J].计算机工程,2019,45(8):184-189.
[12] WANG C,BLEI D M.Collaborative topic modeling for recommending scientific articles[C]//Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2011:448-456.
[13] BLEI D,NG A,JORDAN M.Latent Dirichlet allocation[J].Journal of Machine Learning Research,2003,3:993-1022.
[14] PAN Rong,ZHOU Yunhong,CAO Bin,et al.One-class collaborative filtering[C]//Proceedings of the 8th IEEE International Conference on Data Mining.Washington D.C.,USA:IEEE Press,2008:502-511.
[15] HU Y,KOREN Y,VOLINSKY C.Collaborative filtering for implicit feedback datasets[C]//Proceedings of the 8th IEEE International Conference on Data Mining.Washington D.C.,USA:IEEE Press,2008:263-272.
[16] LIANG D,CHARLIN L,MCINERNEY J,et al.Modeling user exposure in recommendation[C]//Proceedings of the 25th International Conference on World Wide Web.[S.l.]:International World Wide Web Conferences Steering Committee,2016:951-961.
[17] VINCENT P,LAROCHELLE H,LAJOIE I,et al.Stacked denoising autoencoders:learning useful representations in a deep network with a local denoising criterion[J].Journal of Machine Learning Research,2010,11:3371-3408.
[18] HINTON G E,OSINDERO S,TEH Y W.A fast learning algorithm for deep belief nets[J].Neural Computation,2006,18(7):1527-1554.
[19] HINTON G E.Deep belief networks[J].Scholarpedia,2009,4(5):5947.
[20] KINGMA D P,WELLING M.Auto-encoding variational Bayes[EB/OL].[2019-09-11].https://arxiv.org/pdf/1312.6114.pdf.
[21] LI X,SHE J.Collaborative variational autoencoder for recommender systems[C]//Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2017:305-314.
[22] WANG H,WANG N,YEUNG D Y.Collaborative deep learning for recommender systems[C]//Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York,USA:ACM Press,2015:1235-1244.
[23] BOWMAN R,VILNIS L,VINYALS O,et al.Generating sentences from a continuous space[EB/OL].[2019-09-11].https://arxiv.org/pdf/1511.06349.pdf.
[24] STRUB F,GAUDEL R,MARY J.Hybrid recommender system based on autoencoders[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems.New York,USA:ACM Press,2016:11-16.

选择文件类型/文献管理软件名称

选择包含的内容