ABSTRACT
Recommendation systems play a vital role to keep users engaged with personalized content in modern online platforms. Deep learning has revolutionized many research fields and there is a recent surge of interest in applying it to collaborative filtering (CF). However, existing methods compose deep learning architectures with the latent factor model ignoring a major class of CF models, neighborhood or memory-based approaches. We propose Collaborative Memory Networks (CMN), a deep architecture to unify the two classes of CF models capitalizing on the strengths of the global structure of latent factor model and local neighborhood-based structure in a nonlinear fashion. Motivated by the success of Memory Networks, we fuse a memory component and neural attention mechanism as the neighborhood component. The associative addressing scheme with the user and item memories in the memory module encodes complex user-item relations coupled with the neural attention mechanism to learn a user-item specific neighborhood. Finally, the output module jointly exploits the neighborhood with the user and item memories to produce the ranking score. Stacking multiple memory modules together yield deeper architectures capturing increasingly complex user-item relations. Furthermore, we show strong connections between CMN components, memory networks and the three classes of CF models. Comprehensive experimental results demonstrate the effectiveness of CMN on three public datasets outperforming competitive baselines. Qualitative visualization of the attention weights provide insight into the model's recommendation process and suggest the presence of higher order interactions.
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio . 2015. Neural machine translation by jointly learning to align and translate ICLR.Google Scholar
- Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua . 2017. Attentive collaborative filtering: Multimedia recommendation with feature-and item-level attention. In SIGIR. Google ScholarDigital Library
- Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et almbox. . 2016. Wide & Deep Learning for Recommender Systems. In RecSys. Google ScholarDigital Library
- Travis Ebesu and Yi Fang . 2017. Neural Semantic Personalized Ranking for item cold-start recommendation. Information Retrieval Journal Vol. 20, 2, 109--131. Google ScholarDigital Library
- Xue Geng, Hanwang Zhang, Jingwen Bian, and Tat-Seng Chua . 2015. Learning image and user features for recommendation in social networks ICCV. Google ScholarDigital Library
- Yuyun Gong and Qi Zhang . 2016. Hashtag Recommendation Using Attention-Based Convolutional Neural Network. IJCAI. Google ScholarDigital Library
- Ian Goodfellow, Yoshua Bengio, and Aaron Courville . 2016. Deep Learning. MIT Press. http://www.deeplearningbook.org Google ScholarDigital Library
- Alex Graves, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwi'nska, Sergio Gómez Colmenarejo, Edward Grefenstette, Tiago Ramalho, John Agapiou, et almbox. . 2016. Hybrid computing using a neural network with dynamic external memory. Nature, Vol. 538, 7626 (2016), 471--476.Google Scholar
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun . 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In CVPR.Google Scholar
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun . 2016. Deep residual learning for image recognition. In CVPR.Google Scholar
- Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua . 2017. Neural Collaborative Filtering. In WWW. Google ScholarDigital Library
- Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk . 2016. Session-based Recommendations with Recurrent Neural Networks ICLR.Google Scholar
- Haoran Huang, Qi Zhang, Yeyun Gong, and Xuanjing Huang . 2016. Hashtag Recommendation Using End-To-End Memory Networks with Hierarchical Attention. COLING.Google Scholar
- Dietmar Jannach and Malte Ludewig . 2017. When Recurrent Neural Networks Meet the Neighborhood for Session-Based Recommendation RecSys. Google ScholarDigital Library
- Santosh Kabbur, Xia Ning, and George Karypis . 2013. Fism: factored item similarity models for top-n recommender systems SIGKDD. Google ScholarDigital Library
- Donghyun Kim, Chanyoung Park, Jinoh Oh, Sungyoung Lee, and Hwanjo Yu . 2016. Convolutional Matrix Factorization for Document Context-Aware Recommendation RecSys. Google ScholarDigital Library
- Yehuda Koren . 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model SIGKDD. Google ScholarDigital Library
- Ankit Kumar, Ozan Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, and Richard Socher . 2016. Ask Me Anything: Dynamic Memory Networks for Natural Language Processing ICML. Google ScholarDigital Library
- Cheng Li, Xiaoxiao Guo, and Qiaozhu Mei . 2017. Deep Memory Networks for Attitude Identification. WSDM. Google ScholarDigital Library
- Sheng Li, Jaya Kawale, and Yun Fu . 2015. Deep Collaborative Filtering via Marginalized Denoising Auto-encoder CIKM. Google ScholarDigital Library
- Greg Linden, Brent Smith, and Jeremy York . 2003. Amazon.Com Recommendations: Item-to-Item Collaborative Filtering. IEEE Internet Computing Vol. 7, 1. Google ScholarDigital Library
- Paolo Massa and Paolo Avesani . 2007. Trust-aware Recommender Systems. In RecSys. Google ScholarDigital Library
- Xia Ning and George Karypis . 2011. Slim: Sparse linear methods for top-n recommender systems ICDM. Google ScholarDigital Library
- Steffen Rendle . 2010. Factorization machines. In ICDM. Google ScholarDigital Library
- Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-thieme . 2009. BPR : Bayesian Personalized Ranking from Implicit Feedback. UAI (2009). Google ScholarDigital Library
- Francesco Ricci, Lior Rokach, and Bracha Shapira . 2011. Introduction to recommender systems handbook. Springer. Google ScholarDigital Library
- Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton . 2007. Restricted Boltzmann machines for collaborative filtering ICML. Google ScholarDigital Library
- Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie . 2015. AutoRec : Autoencoders Meet Collaborative Filtering. WWW. Google ScholarDigital Library
- Sungyong Seo, Jing Huang, Hao Yang, and Yan Liu . 2017. Interpretable Convolutional Neural Networks with Dual Local and Global Attention for Review Rating Prediction. In RecSys. Google ScholarDigital Library
- Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, and Rob Fergus . 2015. End-To-End Memory Networks. In NIPS. Google ScholarDigital Library
- A"aron van den Oord, Sander Dieleman, and Benjamin Schrauwen . 2013. Deep content-based music recommendation. NIPS. Google ScholarDigital Library
- Chong Wang and David M Blei . 2011. Collaborative topic modeling for recommending scientific articles SIGKDD. Google ScholarDigital Library
- Hao Wang, Naiyan Wang, and Dit-Yan Yeung . 2015. Collaborative deep learning for recommender systems SIGKDD. Google ScholarDigital Library
- Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang . 2017. IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models SIGIR. Google ScholarDigital Library
- Jason Weston, Sumit Chopra, and Antoine Bordes . 2015. Memory Networks ICLR.Google Scholar
- Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J. Smola, and How Jing . 2017. Recurrent Recommender Networks. In WSDM. Google ScholarDigital Library
- Yao Wu, Christopher DuBois, Alice X. Zheng, and Martin Ester . 2016. Collaborative Denoising Auto-Encoders for Top-N Recommender Systems WSDM. Google ScholarDigital Library
- Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua . 2017. Attentional factorization machines: Learning the weight of feature interactions via attention networks. IJCAI. Google ScholarDigital Library
- Caiming Xiong, Stephen Merity, and Richard Socher . 2016. Dynamic memory networks for visual and textual question answering ICML. Google ScholarDigital Library
- Shuai Zhang, Lina Yao, and Aixin Sun . 2017 a. Deep Learning based Recommender System: A Survey and New Perspectives. arXiv:1707.07435 (2017).Google Scholar
- Shuai Zhang, Lina Yao, and Xiwei Xu . 2017 b. AutoSVDGoogle Scholar
- : An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders SIGIR.Google Scholar
Index Terms
- Collaborative Memory Network for Recommendation Systems
Recommendations
Sequential Recommendation with User Memory Networks
WSDM '18: Proceedings of the Eleventh ACM International Conference on Web Search and Data MiningUser preferences are usually dynamic in real-world recommender systems, and a user»s historical behavior records may not be equally important when predicting his/her future interests. Existing recommendation algorithms -- including both shallow and deep ...
Paper Recommendation with Item-Level Collaborative Memory Network
Knowledge Science, Engineering and ManagementAbstractThe recommendation system can recommend information to users personally and efficiently, which satisfies the user’s demand for information in the information age, and has become a hot topic in the current era. In the recommendation system, users ...
Typicality-Based Collaborative Filtering Recommendation
Collaborative filtering (CF) is an important and popular technology for recommender systems. However, current CF methods suffer from such problems as data sparsity, recommendation inaccuracy, and big-error in predictions. In this paper, we borrow ideas ...
Comments