skip to main content
10.1145/3511047.3538030acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
research-article

Being Diverse is Not Enough: Rethinking Diversity Evaluation to Meet Challenges of News Recommender Systems

Published:04 July 2022Publication History

ABSTRACT

Modern societies face many challenges, one of them is the rise of affective polarization over the last 4 decades. In an attempt to understand its reasons, many researchers have questioned the role of Social Media in general, and Recommender Systems (RS) in particular, on the emergence of these extreme behaviors. Diversity in News Recommender Systems (NRS) was quickly perceived as a major issue for the preservation of a healthy democratic debate. However, after more than 15 years of research in Artificial Intelligence on the subject, the understanding of the real impact of diversity in recommendations remains limited. Through a case analysis on the well-known MIND dataset, we propose a critique of the diversity-aware recommendation and evaluation approaches, and provide some take-home messages related to the need of adapted datasets, diversity metrics and analytical methodologies.

Skip Supplemental Material Section

Supplemental Material

video_fairUMAP_Treuillier.mp4

mp4

37.4 MB

References

  1. Panagiotis Adamopoulos and Alexander Tuzhilin. 2014. On Over-Specialization and Concentration Bias of Recommendations: Probabilistic Neighborhood Selection in Collaborative Filtering Systems. In 8th ACM Conference on Recommender Systems (RecSys’14)(RecSys ’14). ACM, Foster City, Silicon Valley, California, USA, 153–160.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Panagiotis Adamopoulos and Alexander Tuzhilin. 2014. On Unexpectedness in Recommender Systems: Or How to Better Expect the Unexpected. ACM Trans. Intell. Syst. Technol. 5, 4 (dec 2014), 32 pages.Google ScholarGoogle Scholar
  3. Gediminas Adomavicius and YoungOk Kwon. 2011. Maximizing Aggregate Recommendation Diversity: A Graph-Theoretic Approach. In Workshop on Novelty and Diversity in Recommender Systems (DiveRS 2011), held in conjunction with ACM RecSys’11. ACM, Chicago, USA, 3–10.Google ScholarGoogle Scholar
  4. Charu C. Aggarwal. 2016. Recommender Systems - The Textbook. Springer, Berlin, Germany. 1–498 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Hunt Allcott, Luca Braghieri, Sarah Eichmeyer, and Matthew Gentzkow. 2020. The Welfare Effects of Social Media. American Economic Review 110, 3 (2020), 629–676.Google ScholarGoogle ScholarCross RefCross Ref
  6. Marcelo G. Armentano, Ingrid Christensen, and Silvia Schiaffino. 2015. Applying the Technology Acceptance Model to Evaluation of Recommender Systems. Polibits 51 (01 2015), 73–79. https://doi.org/10.17562/PB-51-10Google ScholarGoogle Scholar
  7. Christopher A. Bail, Lisa P. Argyle, Taylor W. Brown, John P. Bumpus, Haohan Chen, M. B. Fallin Hunzaker, Jaemin Lee, Marcus Mann, Friedolin Merhout, and Alexander Volfovsky. 2018. Exposure to opposing views on social media can increase political polarization. Proceedings of the National Academy of Sciences 115, 37(2018), 9216–9221.Google ScholarGoogle ScholarCross RefCross Ref
  8. Ian Baracskay, Donald J Baracskay III, Mehtab Iqbal, and Bart Piet Knijnenburg. 2022. The Diversity of Music Recommender Systems. In Proc. of the International conference IUI 2022(Helsinki, Finland) (IUI ’22 Companion). ACM, Helsinki, Finland, 97–100.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Michael D. Bauer. 2021. Diversity in News Recommender Systems. Master’s thesis. echnische Universität Wien.Google ScholarGoogle Scholar
  10. Fabian Baumann, Philipp Lorenz-Spreen, Igor M Sokolov, and Michele Starnini. 2021. Emergence of polarized ideological opinions in multidimensional topic spaces. Physical Review X 11, 1 (2021), 011012.Google ScholarGoogle Scholar
  11. Joeran Beel. 2017. It’s Time to Consider ’Time’ when Evaluating Recommender-System Algorithms. https://arxiv.org/ftp/arxiv/papers/1708/1708.08447.pdf.Google ScholarGoogle Scholar
  12. Abraham Bernstein, Claes de Vreese, Natali Helberger, Wolfgang Schulz, Katharina Zweig, Christian Baden, Michael A Beam, Marc P Hauer, Lucien Heitz, Pascal Jürgens, 2020. Diversity in news recommendations. In erspectives Workshop: Diversity, Fairness, and Data-Driven Personalization in (News) Recommender. Dagstuhl Publishing, Wadern, Germany, 43–61.Google ScholarGoogle Scholar
  13. David M Blei, Andrew Y Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 4-5 (2003), 993–1022. https://doi.org/10.1016/b978-0-12-411519-4.00006-9Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Levi Boxell, Matthew Gentzkow, and Jesse M Shapiro. 2020. Cross-Country Trends in Affective Polarization. Working Paper 26669. National Bureau of Economic Research.Google ScholarGoogle Scholar
  15. Keith Bradley and Barry Smyth. 2001. Improving recommendation diversity. In Proceedings of the twelfth Irish conference on artificial intelligence and cognitive science, Vol. 85. Citeseer, NUIM Department of Computer Science, Maynooth, Ireland, 141–152.Google ScholarGoogle Scholar
  16. Sylvain Castagnos, Nicolas Jones, and Pearl Pu. 2010. Eye-Tracking Product Recommenders’ Usage. In Proceedings of RecSys’10. ACM, Barcelona, 29–36.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Davide Chicco and Giuseppe Jurman. 2020. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics 21, 6 (2020), 13 pages.Google ScholarGoogle Scholar
  18. Davide Chicco, Matthijs J. Warrens, and Giuseppe Jurman. 2021. The coefficient of determination R-squared is more informative than SMAP, MAE, MAPE, MSE and RMSE in regression analysis evaluation. Peerj computer science 7(2021), 24 pages.Google ScholarGoogle Scholar
  19. Uthsav Chitra and Christopher Musco. 2020. Analyzing the Impact of Filter Bubbles on Social Network Polarization. In WSDM’20: Proceedings of the 13th International Conference on Web Search and Data Mining. Houston, Texas, ACM, 115–123. https://doi.org/10.1145/3336191.3371825Google ScholarGoogle Scholar
  20. Matteo Cinelli, Gianmarco De Francisci Morales, Alessandro Galeazzi, Walter Quattrociocchi, and Michele Starnini. 2021. The echo chamber effect on social media. Proceedings of the National Academy of Sciences 118, 9 (2021), e2023301118.Google ScholarGoogle ScholarCross RefCross Ref
  21. Gabriel de Souza Pereira Moreira, Felipe Ferreira, and Adilson Marques da Cunha. 2018. News session-based recommendations using deep neural networks. In Proceedings of the 3rd Workshop on Deep Learning for Recommender Systems. ACM, Vancouver, Canada, 15–23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. James N. Druckman, Samara Klar, Yanna Krupnikov, Matthew Levendusky, and John Barry Barry. 2021. Affective polarization, local contexts and public opinion in America. Nature Human Behaviour 5(2021), 28–38.Google ScholarGoogle ScholarCross RefCross Ref
  23. Yu Du, Sylvie Ranwez, Nicolas Sutton-Charani, and Vincent Ranwez. 2021. Is diversity optimization always suitable? Toward a better understanding of diversity within recommendation approaches. Information Processing & Management 58, 6 (2021), 102721.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Tome Eftimov, Bibek Paudel, Gorjan Popovski, and Dragi Kocev. 2021. A Framework for Evaluating Personalized Ranking Systems by Fusing Different Evaluation Measures. Big Data Research 25(2021), 100211.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Michael D. Ekstrand, F. Maxwell Harper, Martijn C. Willemsen, and Joseph A. Konstan. 2014. User perception of differences in recommender algorithms. In RecSys ’14. ACM, Foster City, USA, 161–168.Google ScholarGoogle Scholar
  26. Eli J. Finkel, Christopher A. Bail, Mina Cikara, Peter H. Ditto, Shanto Iyengar, Samara Klar, Lilliana Mason, Mary C. McGrath, Brendan Nyhan, David G. Rand, Linda J. Skitka, Joshua A. Tucker, Jay J. Van Bavel, Cynthia S. Wang, and James Druckman. 2020. Political sectarianism in America. Science 370, 6516 (2020), 533–536.Google ScholarGoogle Scholar
  27. Daniel Fleder and Kartik Hosanagar. 2008. Blockbuster culture’s next rise or fall: The effect of recommender systems on sales diversity. Management Science 55, 5 (01 2008), 697–712.Google ScholarGoogle Scholar
  28. Florent Garcin, Kai Zhou, Boi Faltings, and Vincent Schickel. 2012. Personalized news recommendation based on collaborative filtering. In Proc. - 2012 IEEE/WIC/ACM Int. Conf. Web Intell. WI 2012. IEEE/ACM, Macau, China, 437–441.Google ScholarGoogle ScholarCross RefCross Ref
  29. Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2018. Quantifying controversy on social media. ACM Transactions on Social Computing 1, 1 (2018), 1–27.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Mouzhi Ge, Carla Delgado, and Dietmar Jannach. 2010. Beyond accuracy: Evaluating recommender systems by coverage and serendipity. In RecSys’10 - Proceedings of the 4th ACM Conference on Recommender Systems. ACM, Barcelona, Spain, 257–260. https://doi.org/10.1145/1864708.1864761Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Fausto Giunchiglia, Jahna Otterbacher, Styliani Kleanthous, Khuyagbaatar Batsuren, Veronika Bogina, Tsvi Kuflik, and Avital Shulner Tal. 2021. Towards Algorithmic Transparency: A Diversity Perspective. ArXiv abs/2104.05658(2021), 11 pages.Google ScholarGoogle Scholar
  32. Jon Atle Gulla, Lemei Zhang, Peng Liu, Özlem Özgöbek, and Xiaomeng Su. 2017. The adressa dataset for news recommendation. In Proceedings of the international conference on web intelligence. ACM, Leipzig Germany, 1042–1048.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Lucien Heitz, Juliane A Lischka, Alena Birrer, Bibek Paudel, Suzanne Tolmeijer, Laura Laugwitz, and Abraham Bernstein. 2022. Benefits of Diverse News Recommendations for Democracy: A User Study. Digital Journalism DOI: 10.1080/21670811.2021.2021804 (2022), 1–21.Google ScholarGoogle Scholar
  34. Natali Helberger. 2019. On the democratic role of news recommenders. Digital Journalism 7, 8 (2019), 993–1012.Google ScholarGoogle ScholarCross RefCross Ref
  35. Rong Hu and Pearl Pu. 2011. Helping Users Perceive Recommendation Diversity. In Workshop on Novelty and Diversity in Recommender Systems (DiveRS 2011), held in conjunction with RecSys’11. ACM, Chicago, USA, 43–50.Google ScholarGoogle Scholar
  36. F.O. Isinkaye, Y.O. Folajimi, and B.A. Ojokoh. 2015. Recommendation systems: Principles, methods and evaluation. Egyptian Informatics Journal 16, 3 (2015), 261–273.Google ScholarGoogle ScholarCross RefCross Ref
  37. Youchun Ji, Wenxing Hong, Yali Shangguan, Huan Wang, and Jing Ma. 2016. Regularized singular value decomposition in news recommendation system. In 2016 11th International Conference on Computer Science & Education (ICCSE). IEEE, Cambridge, UK, 621–626.Google ScholarGoogle ScholarCross RefCross Ref
  38. Nicolas Jones. 2010. User Perceived Qualities and Acceptance of Recommender Systems. PhD Thesis. Ecole Polytechnique Fédérale De Lausanne.Google ScholarGoogle Scholar
  39. Glen Joris, Camiel Colruyt, Judith Vermeulen, Stefaan Vercoutere, Frederik Grove, Kristin Van Damme, Orphee de clercq, Cynthia Van Hee, Lieven Marez, Véronique Hoste, Eva Lievens, Toon De Pessemier, and Luc Martens. 2020. News Diversity and Recommendation Systems: Setting the Interdisciplinary Scene. Springer, Windisch, Switzerland, 90–105.Google ScholarGoogle Scholar
  40. Marius Kaminskas and Derek Bridge. 2016. Diversity, serendipity, novelty, and coverage: a survey and empirical analysis of beyond-accuracy objectives in recommender systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 7, 1(2016), 1–42.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Mahmut Karakaya and Tevfik Aytekin. 2018. Effective methods for increasing aggregate diversity in recommender systems. Knowledge and Information Systems 56 (08 2018). https://doi.org/10.1007/s10115-017-1135-0Google ScholarGoogle Scholar
  42. Mozhgan Karimi, Dietmar Jannach, and Michael Jugovac. 2018. News recommender systems–Survey and roads ahead. Information Processing & Management 54, 6 (2018), 1203–1227.Google ScholarGoogle ScholarCross RefCross Ref
  43. Benjamin Kille, Frank Hopfgartner, Torben Brodt, and Tobias Heintz. 2013. The plista dataset. In Proceedings of the 2013 international news recommender systems workshop and challenge. ACM, Kowloon Hong Kong, 16–23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Brent Kitchens, Steven L. Johnson, and Peter Gray. 2020. Understanding Echo Chambers and Filter Bubbles: The Impact of Social Media on Diversification and Partisan Shifts in News Consumption. MIS Quarterly 44, 4 (2020), 1619–1650.Google ScholarGoogle ScholarCross RefCross Ref
  45. Michal Kompan and Mária Bieliková. 2010. Content-based news recommendation. In International conference on electronic commerce and web technologies. Springer, Bilbao, Spain, 61–72.Google ScholarGoogle ScholarCross RefCross Ref
  46. Emily Kubin and Christian von Sikorski. 2021. The role of (social) media in political polarization: a systematic review. Annals of the International Communication Association 45, 3(2021), 188–206.Google ScholarGoogle ScholarCross RefCross Ref
  47. Matevž Kunaver and Tomaž Požrl. 2017. Diversity in recommender systems–A survey. Knowledge-based systems 123 (2017), 154–162.Google ScholarGoogle Scholar
  48. Neal Lathia, Stephen Hailes, Licia Capra, and Xavier Amatriain. 2010. Temporal diversity in recommender systems. In Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval. ACM, Geneva, Switzerland, 210–217.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Amaury L’Huillier, Sylvain Castagnos, and Anne Boyer. 2014. Understanding Usages by Modeling Diversity over Time. In In extended proceedings of the 22nd Conference on User Modelling, Adaptation and Personalization (UMAP 2014). ACM, Aalborg, Denmark, 6 pages.Google ScholarGoogle Scholar
  50. Lei Li, Li Zheng, Fan Yang, and Tao Li. 2014. Modeling and broadening temporal user interest in personalized news recommendation. Expert Systems with Applications 41, 7 (2014), 3168–3177.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Danyang Liu, Jianxun Lian, Shiyin Wang, Ying Qiao, Jiun-Hung Chen, Guangzhong Sun, and Xing Xie. 2020. KRED: Knowledge-aware document representation for news recommendations. In 14th ACM Conference on Recommender Systems (RecSys’20). ACM, Online, 200–209.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Andreas Lommatzsch, Benjamin Kille, and Sahin Albayrak. 2017. Incorporating context and trends in news recommender systems. In Proceedings of the international conference on web intelligence. IEEE/ACM, Leipzig, Germany, 1062–1068.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Gabriel Machado Lunardi, Guilherme Medeiros Machado, Vinicius Maran, and José Palazzo M. de Oliveira. 2020. A metric for Filter Bubble measurement in recommender algorithms considering the news domain. Applied Soft Computing 97 (2020), 106771.Google ScholarGoogle ScholarCross RefCross Ref
  54. Tapio Luostarinen and Oskar Kohonen. 2013. Using Topic Models in Content-Based News Recommender Systems. Proc. 19th Nord. Conf. Comput. Linguist. (NODALIDA 2013) 2, 1(2013), 239–251. https://aclanthology.org/W13-5622.pdfGoogle ScholarGoogle Scholar
  55. Andrii Maksai, Florent Garcin, and Boi Faltings. 2015. Predicting online performance of news recommender systems through richer evaluation metrics. In Proceedings of the 9th ACM Conference on Recommender Systems. ACM, Vienna, Austria, 179–186.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Maciej A. Mazurowski. 2013. Estimating confidence of individual rating predictions in collaborative filtering recommender systems. Expert Systems with Applications 40, 10 (2013), 3847–3857.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Sean M McNee, John Riedl, and Joseph A Konstan. 2006. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI’06 extended abstracts on Human factors in computing systems. ACM, Montreal, Canada, 1097–1101.Google ScholarGoogle Scholar
  58. Judith Möller, Damian Trilling, Natali Helberger, and Bram van Es. 2018. Do not blame it on the algorithm: an empirical assessment of multiple recommender systems and their impact on content diversity. Information, Communication & Society 21, 7 (2018), 959–977.Google ScholarGoogle ScholarCross RefCross Ref
  59. John O’Donovan and Barry Smyth. 2005. Trust in recommender systems. In International Conference on Intelligent User Interfaces, Proceedings IUI. ACM, San Diego, California, 167–174. https://doi.org/10.1145/1040830.1040870Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Javier Parapar and Filip Radlinski. 2021. Diverse User Preference Elicitation with Multi-Armed Bandits. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. ACM, Stanford CA, USA, 130––138.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Javier Parapar and Filip Radlinski. 2021. Towards Unified Metrics for Accuracy and Diversity for Recommender Systems. In 15th ACM Conference on Recommender Systems (RecSys’21). Association for Computing Machinery, New York, NY, USA, 75–84.Google ScholarGoogle Scholar
  62. Eli Pariser. 2011. The filter bubble: what the Internet is hiding from you. Penguin Press, New York.Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Denis Parra and Shaghayegh Sahebi. 2013. Recommender Systems: Sources of Knowledge and Evaluation Metrics. Springer Berlin Heidelberg, Berlin, Heidelberg, 149–175.Google ScholarGoogle Scholar
  64. Tao Qi, Fangzhao Wu, Chuhan Wu, and Yongfeng Huang. 2021. Personalized news recommendation with knowledge-aware interactive matching. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, Online, 61–70.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Faisal Rahutomo, Teruaki Kitasuka, and Masayoshi Aritsugi. 2012. Semantic cosine similarity. In The 7th International Student Conference on Advanced Science and Technology ICAST. The University of Seoul, Seoul, South Korea, 1.Google ScholarGoogle Scholar
  66. Shaina Raza and Chen Ding. 2019. News recommender system considering temporal dynamics and news taxonomy. In 2019 IEEE International Conference on Big Data (Big Data). IEEE, Los Angeles, CA, USA, 920–929.Google ScholarGoogle ScholarCross RefCross Ref
  67. Shaina Raza and Chen Ding. 2022. News recommender system: a review of recent progress, challenges, and opportunities. Artificial Intelligence Review 55, 1 (2022), 1–52.Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Paul Resnick and Hal R Varian. 1997. Recommender systems. Commun. ACM 40, 3 (1997), 56–58.Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. F. Ricci, L. Rokach, B. Shapira, and P. Kantor. 2011. Recommender systems handbook. Springer, Berlin, Germany.Google ScholarGoogle Scholar
  70. Javier Sanz-Cruzado and Pablo Castells. 2018. Enhancing Structural Diversity in Social Networks by Recommending Weak Ties. In Proceedings of the 12th ACM Conference on Recommender Systems(RecSys ’18). ACM, Vancouver, British Columbia, Canada, 233–241.Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Teresa Scheidt and Joeran Beel. 2021. Time-dependent Evaluation of Recommender Systems. In Perspectives on the Evaluation of Recommender Systems Workshop (PERSPECTIVES 2021), co-located with the 15th ACM Conference on Recommender System (RecSys’21) (Amsterdam, The Netherlands). ACM, Amsterdam, Netherlands, 9 pages.Google ScholarGoogle Scholar
  72. Laura Schelenz. 2021. Diversity-Aware Recommendations for Social Justice? Exploring User Diversity and Fairness in Recommender Systems. Association for Computing Machinery, New York, NY, USA, 404–410.Google ScholarGoogle Scholar
  73. Thiago Silveira, Min Zhang, Xiao Lin, Yiqun Liu, and Shaoping Ma. 2019. How good your recommender system is? A survey on evaluations in recommendation. International Journal of Machine Learning and Cybernetics 10 (2019), 813–831.Google ScholarGoogle ScholarCross RefCross Ref
  74. Barry Smyth and Paul McClave. 2001. Similarity vs. Diversity. In Case-Based Reasoning Research and Development, David W. Aha and Ian Watson (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 347–361.Google ScholarGoogle Scholar
  75. Cass R. Sunstein. 2009. Going to extremes: how like minds unite and divide. Oxford University Press, Oxford, New York.Google ScholarGoogle Scholar
  76. Nava Tintarev, Emily Sullivan, Dror Guldin, Sihang Qiu, and Daan Odjik. 2018. Same, Same, but Different: Algorithmic Diversification of Viewpoints in News. In Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization (Singapore Singapore). ACM, Singapore, 7–13.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Jay J. Van Bavel, Steve Rathje, Elizabeth Harris, Claire Robertson, and Anni Sternisko. 2021. How social media shapes polarization. Trends in Cognitive Sciences 25, 11 (2021), 913–916.Google ScholarGoogle ScholarCross RefCross Ref
  78. Saul Vargas and Pablo Castells. 2011. Rank and relevance in novelty and diversity metrics for recommender systems. In RecSys’11. ACM, Chicago, USA, 109–116.Google ScholarGoogle Scholar
  79. Sanne Vrijenhoek, Mesut Kaya, Nadia Metoui, Judith Möller, Daan Odijk, and Natali Helberger. 2021. Recommenders with a mission: assessing diversity in news recommendations. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval. ACM, Online, 173–183.Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Jacek Wasilewski and Neil J. Hurley. 2016. Incorporating Diversity in a Learning to Rank Recommender System. In FLAIRS Conference. AAAI Press, Key Largo, Florida, 572–577.Google ScholarGoogle Scholar
  81. Chuhan Wu, Fangzhao Wu, Tao Qi, and Yongfeng Huang. 2022. Feedrec: News feed recommendation with various user feedbacks. In Proc. of the International Conference WWW ’22. ACM, Lyon, France, 9 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Chuhan Wu, Fangzhao Wu, Yang Yu, Tao Qi, Yongfeng Huang, and Qi Liu. 2021. NewsBERT: Distilling pre-trained language model for intelligent news application. Findings of the Association for Computational Linguistics EMNLP 2021 (2021), 3285–3295.Google ScholarGoogle ScholarCross RefCross Ref
  83. Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, 2020. Mind: A large-scale dataset for news recommendation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. ACL, Online, 3597–3606.Google ScholarGoogle ScholarCross RefCross Ref
  84. Qiong Wu, Yong Liu, Chunyan Miao, Yin Zhao, Lu Guan, and Haihong Tang. 2019. Recent Advances in Diversified Recommendation. ArXiv abs/1905.06589(2019), 7 pages.Google ScholarGoogle Scholar
  85. Wen Wu and Yu Chen, Liand Zhao. 2018. Personalizing recommendation diversity based on user personality. User Modeling and User-Adapted Interaction 28 (2018), 237––276.Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Liang Xiang, Quan Yuan, Shiwan Zhao, Li Chen, Xiatian Zhang, Qing Yang, and Jimeng Sun. 2010. Temporal recommendation on graphs via long-and short-term preference fusion. In Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, Washington, DC, USA, 723–732.Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Liang Xiong, Xi Chen, Tzu-Kuo Huang, Jeff Schneider, and Jaime G Carbonell. 2010. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In Proceedings of the 2010 SIAM international conference on data mining. SIAM, Columbus, Ohio, USA, 211–222.Google ScholarGoogle ScholarCross RefCross Ref
  88. Rui Ye, Y. Hou, Te Lei, Yunxing Zhang, Qing Zhang, Jiale Guo, Huaiwen Wu, and Hengliang Luo. 2021. Dynamic Graph Construction for Improving Diversity of Recommendation. In Fifteenth ACM Conference on Recommender Systems. ACM, Amsterdam, Netherlands, 651––655.Google ScholarGoogle Scholar
  89. Liang Zhang. 2013. The Definition of Novelty in Recommendation System. Journal of Engineering Science and Technology Review 6, 3 (2013), 141–145.Google ScholarGoogle ScholarCross RefCross Ref
  90. M. Zhang and N. Hurley. 2008. Avoiding monotony: Improving the diversity of recommendation lists. In Proceedings of 2nd ACM International Conference on Recommender Systems. ACM, Lausanne, Switzerland, 123––130.Google ScholarGoogle Scholar
  91. Tao Zhou, Zoltán Kuscsik, Jian-Guo Liu, Matúš Medo, Joseph Rushton Wakeling, and Yi-Cheng Zhang. 2010. Solving the apparent diversity-accuracy dilemma of recommender systems. Proceedings of the National Academy of Sciences 107, 10(2010), 4511–4515.Google ScholarGoogle ScholarCross RefCross Ref
  92. Cai-Nicolas Ziegler, Sean M McNee, Joseph A Konstan, and Georg Lausen. 2005. Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on World Wide Web. ACM, Chiba, Japan, 22–32.Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Conferences
    UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization
    July 2022
    409 pages
    ISBN:9781450392327
    DOI:10.1145/3511047

    Copyright © 2022 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 4 July 2022

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate162of633submissions,26%

    Upcoming Conference

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format