ABSTRACT
Many aspects and properties of Recommender Systems have been well studied in the past decade, however, the impact of User Fatigue has been mostly ignored in the literature. User fatigue represents the phenomenon that a user quickly loses the interest on the recommended item if the same item has been presented to this user multiple times before. The direct impact caused by the user fatigue is the dramatic decrease of the Click Through Rate (CTR, i.e., the ratio of clicks to impressions). In this paper, we present a comprehensive study on the research of the user fatigue in online recommender systems. By analyzing user behavioral logs from Bing Now news recommendation, we find that user fatigue is a severe problem that greatly affects the user experience. We also notice that different users engage differently with repeated recommendations. Depending on the previous users' interaction with repeated recommendations, we illustrate that under certain condition the previously seen items should be demoted, while some other times they should be promoted. We demonstrate how statistics about the analysis of the user fatigue can be incorporated into ranking algorithms for personalized recommendations. Our experimental results indicate that significant gains can be achieved by introducing features that reflect users' interaction with previously seen recommendations (up to 15% enhancement on all users and 34% improvement on heavy users).
- G. Adomavicius and A. Tuzhilin. Context-aware recommender systems. In Recommender Systems Handbook, pages 217--253. 2011. Google ScholarCross Ref
- D. Agarwal, B. Chen, and P. Elango. Spatio-temporal models for estimating click-through rate. In Proceedings of WWW 2009, pages 21--30, 2009. Google ScholarDigital Library
- N. Buchbinder, M. Feldman, A. Ghosh, and J. Naor. Frequency capping in online advertising. Journal of Scheduling, 17(4):385--398, 2014. Google ScholarDigital Library
- W. Chen, W. Hsu, and M. L. Lee. Modeling user's receptiveness over time for recommendation. In Proceedings of SIGIR 2013, pages 373--382, 2013. Google ScholarDigital Library
- W. Chu and S.-T. Park. Personalized recommendation on dynmic content using predictive bilinear models. In Proceedings of WWW 2009, pages 691--700, 2009. Google ScholarDigital Library
- N. Craswell, O. Zoeter, M. J. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In Proceedings of WSDM 2008, pages 87--94, 2008. Google ScholarDigital Library
- K. Kim, J. G. Park, and S. Cho. Correlation analysis and performance evaluation of distance measures for evolutionary neural networks. Journal of Intelligent and Fuzzy Systems, 22(2--3):83--92, 2011. Google ScholarDigital Library
- Y. Koren. Collaborative filtering with temporal dynamics. In Proceedings of KDD 2009, pages 447--456, 2009. Google ScholarDigital Library
- Y. Koren. Collaborative filtering with temporal dynamics. Commun. ACM, 53(4):89--97, 2010. Google ScholarDigital Library
- Y. Koren, R. M. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. IEEE Computer, 42(8):30--37, 2009. Google ScholarDigital Library
- N. Lathia, S. Hailes, L. Capra, and X. Amatriain. Temporal diversity in recommender systems. In Proceeding of SIGIR 2010, pages 210--217, 2010. Google ScholarDigital Library
- P. Lee, L. V. Lakshmanan, M. Tiwari, and S. Shah. Modeling impression discounting in large-scale recommender systems. In Proceedings of KDD 2014, pages 1837--1846, 2014. Google ScholarDigital Library
- H. Ma, D. Zhou, C. Liu, M. R. Lyu, and I. King. Recommender systems with social regularization. In Proceedings of WSDM 2011, pages 287--296, 2011. Google ScholarDigital Library
- M. Richardson, E. Dominowska, and R. Ragno. Predicting clicks: estimating the click-through rate for new ads. In Proceedings of WWW 2007, pages 521--530, 2007. Google ScholarDigital Library
- M. Shokouhi, R. W. White, P. N. Bennett, and F. Radlinski. Fighting search engine amnesia: reranking repeated results. In Proceedings of SIGIR 2013, pages 273--282, 2013. Google ScholarDigital Library
- J. Teevan, D. J. Liebling, and G. R. Geetha. Understanding and predicting personal navigation. In Proceedings of WSDM 2011, pages 85--94, 2011. Google ScholarDigital Library
- S. Vargas and P. Castells. Rank and relevance in novelty and diversity metrics for recommender systems. In Proceedings of RecSys 2011, pages 109--116, 2011. Google ScholarDigital Library
- Q. Wu, C. J. C. Burges, K. M. Svore, and J. Gao. Adapting boosting for information retrieval measures. Inf. Retr., 13(3):254--270, 2010. Google ScholarDigital Library
- L. Xiang, Q. Yuan, S. Zhao, L. Chen, X. Zhang, Q. Yang, and J. Sun. Temporal recommendation on graphs via long and short-term preference fusion. In Proceedings of KDD 2010, pages 723--731, 2010. Google ScholarDigital Library
- L. Xiong, X. Chen, T.-K. Huang, J. Schneider, and J. G. Carbonell. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In Proceedings of SDM, 2010. Google ScholarCross Ref
- X. Yi, L. Hong, E. Zhong, N. N. Liu, and S. Rajan. Beyond clicks: Dwell time for personalization. In Proceedings of RecSys 2014, pages 113--120, 2014. Google ScholarDigital Library
- P. Yin, P. Luo, W.-C. Lee, and M. Wang. Silence is also evidence: Interpreting dwell time for recommendation from psychological perspective. In Proceedings of KDD 2013, pages 989--997, 2013. Google ScholarDigital Library
- Y. Yue, R. Patel, and H. Roehrig. Beyond position bias: examining result attractiveness as a source of presentation bias in clickthrough data. In Proceedings of WWW 2010, pages 1011--1018, 2010. Google ScholarDigital Library
- Y. C. Zhang, D. O. Seaghdha, D. Quercia, and T. Jambor. Aurallist: Introducing serendipity into music recommendation. In Proceedings of WSDM 2012, pages 13--22, 2012. Google ScholarDigital Library
Index Terms
- User Fatigue in Online News Recommendation
Recommendations
Multi-granularity Fatigue in Recommendation
CIKM '22: Proceedings of the 31st ACM International Conference on Information & Knowledge ManagementPersonalized recommendation aims to provide appropriate items according to user preferences mainly from their behaviors. Excessive homogeneous user behaviors on similar items will lead to fatigue, which may decrease user activeness and degrade user ...
Do Not Read the Same News! Enhancing Diversity and Personalization of News Recommendation
WWW '22: Companion Proceedings of the Web Conference 2022Personalized news recommendation by machine is one of the widely studied areas. As the production of news articles increases and topics are diversified, it is impractical to read all the articles available to users. Therefore, the purpose of the news ...
Cross-representation mediation of user models
Personalization is considered a powerful methodology for improving the effectiveness of information search and decision making. It has led to the dissemination of systems capable of suggesting relevant and personalized information (or items) to the users,...
Comments