skip to main content
10.1145/3159652.3159656acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding

Published:02 February 2018Publication History

ABSTRACT

Top-N sequential recommendation models each user as a sequence of items interacted in the past and aims to predict top-N ranked items that a user will likely interact in a »near future». The order of interaction implies that sequential patterns play an important role where more recent items in a sequence have a larger impact on the next item. In this paper, we propose a Convolutional Sequence Embedding Recommendation Model »Caser» as a solution to address this requirement. The idea is to embed a sequence of recent items into an »image» in the time and latent spaces and learn sequential patterns as local features of the image using convolutional filters. This approach provides a unified and flexible network structure for capturing both general preferences and sequential patterns. The experiments on public data sets demonstrated that Caser consistently outperforms state-of-the-art sequential recommendation methods on a variety of common evaluation metrics.

References

  1. Rakesh Agrawal and Ramakrishnan Srikant . 1995. Mining sequential patterns. In International Conference on Data Engineering. IEEE, 3--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Chen Cheng, Haiqin Yang, Michael R Lyu, and Irwin King . 2013. Where You Like to Go Next: Successive Point-of-Interest Recommendation. International Joint Conference on Artificial Intelligence. 2605--2611. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Eunjoon Cho, Seth A Myers, and Jure Leskovec . 2011. Friendship and mobility: user movement in location-based social networks International Conference on Knowledge Discovery and Data Mining. ACM, 1082--1090. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Jiawei Han, Jian Pei, and Micheline Kamber . 2011. Data mining: concepts and techniques. Elsevier. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. R. He, W.-C. Kang, and J. McAuley . 2017 a. Translation-based recommendation. In ACM Conference on Recommender systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. R. He and J. McAuley . 2016. Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendation International Conference on Data Mining. IEEE.Google ScholarGoogle Scholar
  7. Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua . 2017 b. Neural collaborative filtering. In International Conference on World Wide Web. ACM, 173--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk . 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).Google ScholarGoogle Scholar
  9. Yifan Hu, Yehuda Koren, and Chris Volinsky . 2008. Collaborative filtering for implicit feedback datasets International Conference on Data Mining. IEEE, 263--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Dietmar Jannach and Malte Ludewig . 2017. When Recurrent Neural Networks meet the Neighborhood for Session-Based Recommendation ACM Conference on Recommender systems. ACM, 306--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Andrej Karpathy, George Toderici, Sanketh Shetty, Thomas Leung, Rahul Sukthankar, and Li Fei-Fei . 2014. Large-scale video classification with convolutional neural networks IEEE conference on Computer Vision and Pattern Recognition. 1725--1732. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Yoon Kim . 2014. Convolutional Neural Networks for Sentence Classification Conference on Empirical Methods on Natural Language Processing. ACL, 1756--1751.Google ScholarGoogle Scholar
  13. Diederik Kingma and Jimmy Ba . 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).Google ScholarGoogle Scholar
  14. Yehuda Koren . 2010. Collaborative filtering with temporal dynamics. Commun. ACM Vol. 53, 4 (2010), 89--97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Yehuda Koren, Robert Bell, and Chris Volinsky . 2009. Matrix factorization techniques for recommender systems. Computer, Vol. 42, 8 (2009). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton . 2012. Imagenet classification with deep convolutional neural networks Advances in Neural Information Processing Systems. 1097--1105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Duen-Ren Liu, Chin-Hui Lai, and Wang-Jung Lee . 2009. A hybrid of sequential rules and collaborative filtering for product recommendation. Information Sciences Vol. 179, 20 (2009), 3505--3519. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Tomas Mikolov, Martin Karafiát, Lukas Burget, Jan Cernockỳ, and Sanjeev Khudanpur . 2010. Recurrent neural network based language model.. In Interspeech, Vol. Vol. 2. 3.Google ScholarGoogle ScholarCross RefCross Ref
  19. Rong Pan, Yunhong Zhou, Bin Cao, Nathan N Liu, Rajan Lukose, Martin Scholz, and Qiang Yang . 2008. One-class collaborative filtering. In International Conference on Data Mining. IEEE, 502--511. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme . 2009. BPR: Bayesian personalized ranking from implicit feedback Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452--461. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme . 2010. Factorizing personalized markov chains for next-basket recommendation International Conference on World Wide Web. ACM, 811--820. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ruslan Salakhutdinov and Andriy Mnih . 2007. Probabilistic Matrix Factorization.. In Advances in Neural Information Processing Systems, Vol. Vol. 1. 2--1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton . 2007. Restricted Boltzmann machines for collaborative filtering International Conference on Machine learning. ACM, 791--798. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl . 2001. Item-based collaborative filtering recommendation algorithms International Conference on World Wide Web. ACM, 285--295. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie . 2015. Autorec: Autoencoders meet collaborative filtering International Conference on World Wide Web. ACM, 111--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Yang Song, Ali Mamdouh Elkahky, and Xiaodong He . 2016. Multi-rate deep learning for temporal recommendation International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 909--912. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov . 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Research Vol. 15, 1 (2014), 1929--1958. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Andrea Vedaldi and Karel Lenc . 2015. Matconvnet: Convolutional neural networks for matlab International conference on Multimedia. ACM, 689--692. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Hao Wang, Naiyan Wang, and Dit-Yan Yeung . 2015 b. Collaborative deep learning for recommender systems International Conference on Knowledge Discovery and Data Mining. ACM, 1235--1244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Pengfei Wang, Jiafeng Guo, Yanyan Lan, Jun Xu, Shengxian Wan, and Xueqi Cheng . 2015 a. Learning hierarchical representation model for nextbasket recommendation International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 403--412. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J. Smola, and How Jing . 2017. Recurrent Recommender Networks. In International Conference on Web Search and Data Mining. ACM, 495--503. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Yao Wu, Christopher DuBois, Alice X Zheng, and Martin Ester . 2016. Collaborative denoising auto-encoders for top-n recommender systems International Conference on Web Search and Data Mining. ACM, 153--162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Quan Yuan, Gao Cong, and Aixin Sun . 2014. Graph-based point-of-interest recommendation with geographical and temporal influences International Conference on Information and Knowledge Management. ACM, 659--668. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Chenyi Zhang, Ke Wang, Hongkun Yu, Jianling Sun, and Ee-Peng Lim . 2014. Latent factor transition for dynamic collaborative filtering SIAM International Conference on Data Mining. SIAM, 452--460.Google ScholarGoogle Scholar
  35. Shenglin Zhao, Tong Zhao, Haiqin Yang, Michael R Lyu, and Irwin King . 2016. Stellar: spatial-temporal latent ranking for successive point-of-interest recommendation AAAI Conference on Artificial Intelligence. AAAI Press, 315--321. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Lei Zheng, Vahid Noroozi, and Philip S. Yu . 2017. Joint Deep Modeling of Users and Items Using Reviews for Recommendation International Conference on Web Search and Data Mining. ACM, 425--434. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Personalized Top-N Sequential Recommendation via Convolutional Sequence Embedding

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      WSDM '18: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining
      February 2018
      821 pages
      ISBN:9781450355810
      DOI:10.1145/3159652

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 2 February 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      WSDM '18 Paper Acceptance Rate81of514submissions,16%Overall Acceptance Rate498of2,863submissions,17%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader