Kohei Hirata
ABSTRACT
Maximum inner product search (or k-MIPS) is a fundamental operation in recommender systems that infer preferable items for users. To support large-scale recommender systems, existing studies designed scalable k-MIPS algorithms. However, these studies do not consider diversity, although recommending diverse items is important to improve user satisfaction. We therefore formulate a new problem, namely diversity-aware k-MIPS. In this problem, users can control the degree of diversity in their recommendation lists through a parameter. However, exactly solving this problem is unfortunately NP-hard, so it is challenging to devise an efficient, effective, and practical algorithm for the diversity-aware k-MIPS problem. This paper overcomes this challenge and proposes IP-Greedy, which incorporates new early termination and skipping techniques into a greedy algorithm. We conduct extensive experiments on real datasets, and the results demonstrate the efficiency and effectiveness of our algorithm. Also, we conduct a case study of the diversity-aware k-MIPS problem on a real dataset. We confirm that this problem can make recommendation lists diverse while preserving high inner products of user and item vectors in the lists.
Supplemental Material
- Mustafa Abdool, Malay Haldar, Prashant Ramanathan, Tyler Sax, Lanbo Zhang, Aamir Manaswala, Lynn Yang, Bradley Turnbull, Qing Zhang, and Thomas Legrand. 2020. Managing Diversity in Airbnb Search. In KDD. 2952–2960.Google Scholar
- Daichi Amagata and Takahiro Hara. 2016. Diversified set monitoring over distributed data streams. In DEBS. 1–12.Google Scholar
- Daichi Amagata and Takahiro Hara. 2021. Reverse Maximum Inner Product Search: How to efficiently find users who would like to buy my item?. In RecSys. 273–281.Google Scholar
- Ashton Anderson, Lucas Maystre, Ian Anderson, Rishabh Mehrotra, and Mounia Lalmas. 2020. Algorithmic Effects on the Diversity of Consumption on Spotify. In The Web Conference. 2155–2165.Google Scholar
- Vito Walter Anelli, Alejandro Bellogín, Tommaso Di Noia, and Claudio Pomo. 2021. Reenvisioning the Comparison between Neural Collaborative Filtering and Matrix Factorization. In RecSys. 521–529.Google Scholar
- Yoram Bachrach, Yehuda Finkelstein, Ran Gilad-Bachrach, Liran Katzir, Noam Koenigstein, Nir Nice, and Ulrich Paquet. 2014. Speeding up the xbox recommender system using a euclidean transformation for inner-product spaces. In RecSys. 257–264.Google Scholar
- Oren Barkan and Noam Koenigstein. 2016. Item2vec: Neural Item Embedding for Collaborative Filtering. In International Workshop on Machine Learning for Signal Processing. 1–6.Google ScholarCross Ref
- Jaime Carbonell and Jade Goldstein. 1998. The use of MMR, diversity-based reranking for reordering documents and producing summaries. In SIGIR. 335–336.Google Scholar
- Ilio Catallo, Eleonora Ciceri, Piero Fraternali, Davide Martinenghi, and Marco Tagliasacchi. 2013. Top-k Diversity Queries over Bounded Regions. ACM Transactions on Database Systems 38, 2 (2013), 1–44.Google ScholarDigital Library
- Laming Chen, Guoxin Zhang, and Eric Zhou. 2018. Fast Greedy MAP Inference for Determinantal Point Process to Improve Recommendation Diversity. NeurIPS 31(2018).Google Scholar
- Peizhe Cheng, Shuaiqiang Wang, Jun Ma, Jiankai Sun, and Hui Xiong. 2017. Learning to Recommend Accurate and Diverse Items. In World Wide Web. 183–192.Google Scholar
- Wei-Sheng Chin, Bo-Wen Yuan, Meng-Yuan Yang, Yong Zhuang, Yu-Chin Juan, and Chih-Jen Lin. 2016. LIBMF: A Library for Parallel Matrix Factorization in Shared-memory Systems. The Journal of Machine Learning Research 17, 1 (2016), 2971–2975.Google ScholarDigital Library
- Xinyan Dai, Xiao Yan, Kelvin KW Ng, Jiu Liu, and James Cheng. 2020. Norm-Explicit Quantization: Improving Vector Quantization for Maximum Inner Product Search. In AAAI. 51–58.Google Scholar
- Qin Ding, Hsiang-Fu Yu, and Cho-Jui Hsieh. 2019. A Fast Sampling Algorithm for Maximum Inner Product Search. In AISTATS. 3004–3012.Google Scholar
- Marina Drosou and Evaggelia Pitoura. 2010. Search Result Diversification. ACM SIGMOD Record 39, 1 (2010), 41–47.Google ScholarDigital Library
- Marina Drosou and Evaggelia Pitoura. 2015. Multiple Radii Disc Diversity: Result Diversification Based on Dissimilarity and Coverage. ACM Transactions on Database Systems 40, 1 (2015), 1–43.Google ScholarDigital Library
- Steven Essinger, Dave Huber, and Daniel Tang. 2021. AIR: Personalized Product Recommender System for Nike’s Digital Transformation. In RecSys. 530–532.Google Scholar
- Piero Fraternali, Davide Martinenghi, and Marco Tagliasacchi. 2012. Top-k Bounded Diversification. In SIGMOD. 421–432.Google Scholar
- Xiaoyu Ge and Panos K Chrysanthis. 2020. Efficient PrefDiv Algorithms for Effective Top-k Result Diversification.. In EDBT. 335–346.Google Scholar
- Sreenivas Gollapudi and Aneesh Sharma. 2009. An Axiomatic Approach for Result Diversification. In World Wide Web. 381–390.Google Scholar
- Ruiqi Guo, Philip Sun, Erik Lindgren, Quan Geng, David Simcha, Felix Chern, and Sanjiv Kumar. 2020. Accelerating Large-scale Inference with Anisotropic Vector Quantization. In ICML. 3887–3896.Google Scholar
- Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-class Collaborative Filtering. In World Wide Web. 507–517.Google Scholar
- Zhengbao Jiang, Ji-Rong Wen, Zhicheng Dou, Wayne Xin Zhao, Jian-Yun Nie, and Ming Yue. 2017. Learning to Diversify Search Results via Subtopic Attention. In SIGIR. 545–554.Google Scholar
- Marius Kaminskas and Derek Bridge. 2016. Diversity, Serendipity, Novelty, and Coverage: A Survey and Empirical Analysis of Beyond-accuracy Objectives in Recommender Systems. ACM Transactions on Interactive Intelligent Systems 7, 1 (2016), 1–42.Google ScholarDigital Library
- Mozhgan Karimi, Dietmar Jannach, and Michael Jugovac. 2018. News Recommender Systems–Survey and Roads Ahead. Information Processing & Management 54, 6 (2018), 1203–1227.Google ScholarCross Ref
- Daniel James Kershaw, Rob Koeling, Stephan Bourgeois, Antonio Trenta, and Harriet J Muncey. 2021. Fairness in Reviewer Recommendations at Elsevier. In RecSys. 554–555.Google Scholar
- Vijay Keswani and L Elisa Celis. 2021. Dialect Diversity in Text Summarization on Twitter. In The Web Conference. 3802–3814.Google Scholar
- Matevž Kunaver and Tomaž Požrl. 2017. Diversity in Recommender Systems–A Survey. Knowledge-based systems 123 (2017), 154–162.Google Scholar
- Sudarshan Dnyaneshwar Lamkhede and Christoph Kofler. 2021. Recommendations and Results Organization in Netflix Search. In RecSys. 577–579.Google Scholar
- Chang Li, Haoyun Feng, and Maarten de Rijke. 2020. Cascading Hybrid Bandits: Online Learning to Rank for Relevance and Diversity. In RecSys. 33–42.Google Scholar
- Hui Li, Tsz Nam Chan, Man Lung Yiu, and Nikos Mamoulis. 2017. FEXIPRO: fast and exact inner product retrieval in recommender systems. In SIGMOD. 835–850.Google Scholar
- Yile Liang, Tieyun Qian, Qing Li, and Hongzhi Yin. 2021. Enhancing Domain-Level and User-Level Adaptivity in Diversified Recommendation. In SIGIR. 747–756.Google Scholar
- Jie Liu, Xiao Yan, Xinyan Dai, Zhirong Li, James Cheng, and Ming-Chang Yang. 2020. Understanding and Improving Proximity Graph Based Maximum Inner Product Search. In AAAI. 139–146.Google Scholar
- Hayato Nakama, Daichi Amagata, and Takahiro Hara. 2021. Approximate Top-k Inner Product Join with a Proximity Graph. In IEEE Big Data. 4468–4471.Google Scholar
- Lu Qin, Jeffrey Xu Yu, and Lijun Chang. 2012. Diversifying Top-k Results. PVLDB 5, 11 (2012), 1124–1135.Google ScholarDigital Library
- Parikshit Ram and Alexander G Gray. 2012. Maximum inner-product search using cone trees. In KDD. 931–939.Google Scholar
- Sekharipuram S Ravi, Daniel J Rosenkrantz, and Giri Kumar Tayi. 1994. Heuristic and special case algorithms for dispersion problems. Operations Research 42, 2 (1994), 299–310.Google ScholarDigital Library
- Steffen Rendle, Walid Krichene, Li Zhang, and John Anderson. 2020. Neural Collaborative Filtering vs. Matrix Factorization Revisited. In RecSys. 240–248.Google Scholar
- Yang Song, Yu Gu, Rui Zhang, and Ge Yu. 2021. ProMIPS: Efficient High-Dimensional c-Approximate Maximum Inner Product Search with a Lightweight Index. In ICDE. 1619–1630.Google Scholar
- Harald Steck, Linas Baltrunas, Ehtsham Elahi, Dawen Liang, Yves Raimond, and Justin Basilico. 2021. Deep Learning for Recommender Systems: A Netflix Case Study. AI Magazine 42, 3 (2021), 7–18.Google ScholarDigital Library
- Zhan Su, Zhicheng Dou, Yutao Zhu, Xubo Qin, and Ji-Rong Wen. 2021. Modeling Intent Graph for Search Result Diversification. In SIGIR. 736–746.Google Scholar
- Shulong Tan, Zhaozhuo Xu, Weijie Zhao, Hongliang Fei, Zhixin Zhou, and Ping Li. 2021. Norm Adjusted Proximity Graph for Fast Inner Product Retrieval. In KDD. 1552–1560.Google Scholar
- Christina Teflioudi and Rainer Gemulla. 2016. Exact and Approximate Maximum Inner Product Search with LEMP. ACM Transactions on Database Systems 42, 1 (2016), 1–49.Google ScholarDigital Library
- Christina Teflioudi, Rainer Gemulla, and Olga Mykytiuk. 2015. LEMP: Fast Retrieval of Large Entries in a Matrix Product. In SIGMOD. 107–122.Google ScholarDigital Library
- Duong Chi Thang, Nguyen Thanh Tam, Nguyen Quoc Viet Hung, and Karl Aberer. 2015. An Evaluation of Diversification Techniques. In DEXA. 215–231.Google Scholar
- Hanxin Wang, Daichi Amagata, Takuya Makeawa, Takahiro Hara, Niu Hao, Kei Yonekawa, and Mori Kurokawa. 2020. A DNN-Based Cross-Domain Recommender System for Alleviating Cold-Start Problem in E-Commerce. IEEE Open Journal of the Industrial Electronics Society 1 (2020), 194–206.Google ScholarCross Ref
- Jing Wang, Feng Tian, Hongchuan Yu, Chang Hong Liu, Kun Zhan, and Xiao Wang. 2017. Diverse Non-negative Matrix Factorization for Multiview Data Representation. IEEE Transactions on Cybernetics 48, 9 (2017), 2620–2632.Google ScholarCross Ref
- Long Xia, Jun Xu, Yanyan Lan, Jiafeng Guo, and Xueqi Cheng. 2015. Learning Maximal Marginal Relevance Model via Directly Optimizing Diversity Evaluation Measures. In SIGIR. 113–122.Google Scholar
- Le Yan, Zhen Qin, Rama Kumar Pasumarthi, Xuanhui Wang, and Michael Bendersky. 2021. Diversification-Aware Learning to Rank using Distributed Representation. In The Web Conference. 127–136.Google ScholarDigital Library
- Rui Ye, Yuqing Hou, Te Lei, Yunxing Zhang, Qing Zhang, Jiale Guo, Huaiwen Wu, and Hengliang Luo. 2021. Dynamic Graph Construction for Improving Diversity of Recommendation. In RecSys. 651–655.Google Scholar
- Hamed Zamani and W Bruce Croft. 2020. Learning a Joint Search and Recommendation Model from User-Item Interactions. In WSDM. 717–725.Google Scholar
- Guangyi Zhang and Aristides Gionis. 2020. Maximizing Diversity over Clustered Data. In SDM. 649–657.Google Scholar
- Xing Zhao, Ziwei Zhu, Yin Zhang, and James Caverlee. 2020. Improving the Estimation of Tail Ratings in Recommender System with Multi-Latent Representations. In WSDM. 762–770.Google Scholar
- Yadong Zhu, Yanyan Lan, Jiafeng Guo, Xueqi Cheng, and Shuzi Niu. 2014. Learning for search result diversification. In SIGIR. 293–302.Google Scholar
Index Terms
- Solving Diversity-Aware Maximum Inner Product Search Efficiently and Effectively
Recommendations
Individual Diversity Preference Aware Neural Collaborative Filtering
AbstractThe diversified recommendation of recommender systems enriches user experiences by diversifying recommendation lists. However, the conventional post-processing strategy, which re-ranking the recommendation lists by diversity ...
Highlights- IDP-NCF is an in-processing diversified recommendation method.
- Two elements of ...
A Clustering Approach for Personalizing Diversity in Collaborative Recommender Systems
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and PersonalizationMuch of the focus of recommender systems research has been on the accurate prediction of users' ratings for unseen items. Recent work has suggested that objectives such as diversity and novelty in recommendations are also important factors in the ...
A Novel Framework for Improving Recommender Diversity
International Workshop on Behavior and Social Informatics on Behavior and Social Computing - Volume 8178Recommender systems are being used to assist users in finding relevant items from a large set of alternatives in many online applications. However, while most research up to this point has focused on improving the accuracy of recommender systems, other ...
Comments