skip to main content
10.1145/2872427.2874813acmotherconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

User Fatigue in Online News Recommendation

Published:11 April 2016Publication History

ABSTRACT

Many aspects and properties of Recommender Systems have been well studied in the past decade, however, the impact of User Fatigue has been mostly ignored in the literature. User fatigue represents the phenomenon that a user quickly loses the interest on the recommended item if the same item has been presented to this user multiple times before. The direct impact caused by the user fatigue is the dramatic decrease of the Click Through Rate (CTR, i.e., the ratio of clicks to impressions). In this paper, we present a comprehensive study on the research of the user fatigue in online recommender systems. By analyzing user behavioral logs from Bing Now news recommendation, we find that user fatigue is a severe problem that greatly affects the user experience. We also notice that different users engage differently with repeated recommendations. Depending on the previous users' interaction with repeated recommendations, we illustrate that under certain condition the previously seen items should be demoted, while some other times they should be promoted. We demonstrate how statistics about the analysis of the user fatigue can be incorporated into ranking algorithms for personalized recommendations. Our experimental results indicate that significant gains can be achieved by introducing features that reflect users' interaction with previously seen recommendations (up to 15% enhancement on all users and 34% improvement on heavy users).

References

  1. G. Adomavicius and A. Tuzhilin. Context-aware recommender systems. In Recommender Systems Handbook, pages 217--253. 2011. Google ScholarGoogle ScholarCross RefCross Ref
  2. D. Agarwal, B. Chen, and P. Elango. Spatio-temporal models for estimating click-through rate. In Proceedings of WWW 2009, pages 21--30, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. N. Buchbinder, M. Feldman, A. Ghosh, and J. Naor. Frequency capping in online advertising. Journal of Scheduling, 17(4):385--398, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. W. Chen, W. Hsu, and M. L. Lee. Modeling user's receptiveness over time for recommendation. In Proceedings of SIGIR 2013, pages 373--382, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. W. Chu and S.-T. Park. Personalized recommendation on dynmic content using predictive bilinear models. In Proceedings of WWW 2009, pages 691--700, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. N. Craswell, O. Zoeter, M. J. Taylor, and B. Ramsey. An experimental comparison of click position-bias models. In Proceedings of WSDM 2008, pages 87--94, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. K. Kim, J. G. Park, and S. Cho. Correlation analysis and performance evaluation of distance measures for evolutionary neural networks. Journal of Intelligent and Fuzzy Systems, 22(2--3):83--92, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Y. Koren. Collaborative filtering with temporal dynamics. In Proceedings of KDD 2009, pages 447--456, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Y. Koren. Collaborative filtering with temporal dynamics. Commun. ACM, 53(4):89--97, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Y. Koren, R. M. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. IEEE Computer, 42(8):30--37, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. N. Lathia, S. Hailes, L. Capra, and X. Amatriain. Temporal diversity in recommender systems. In Proceeding of SIGIR 2010, pages 210--217, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. P. Lee, L. V. Lakshmanan, M. Tiwari, and S. Shah. Modeling impression discounting in large-scale recommender systems. In Proceedings of KDD 2014, pages 1837--1846, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. H. Ma, D. Zhou, C. Liu, M. R. Lyu, and I. King. Recommender systems with social regularization. In Proceedings of WSDM 2011, pages 287--296, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. M. Richardson, E. Dominowska, and R. Ragno. Predicting clicks: estimating the click-through rate for new ads. In Proceedings of WWW 2007, pages 521--530, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Shokouhi, R. W. White, P. N. Bennett, and F. Radlinski. Fighting search engine amnesia: reranking repeated results. In Proceedings of SIGIR 2013, pages 273--282, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. Teevan, D. J. Liebling, and G. R. Geetha. Understanding and predicting personal navigation. In Proceedings of WSDM 2011, pages 85--94, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. S. Vargas and P. Castells. Rank and relevance in novelty and diversity metrics for recommender systems. In Proceedings of RecSys 2011, pages 109--116, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Q. Wu, C. J. C. Burges, K. M. Svore, and J. Gao. Adapting boosting for information retrieval measures. Inf. Retr., 13(3):254--270, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. L. Xiang, Q. Yuan, S. Zhao, L. Chen, X. Zhang, Q. Yang, and J. Sun. Temporal recommendation on graphs via long and short-term preference fusion. In Proceedings of KDD 2010, pages 723--731, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. L. Xiong, X. Chen, T.-K. Huang, J. Schneider, and J. G. Carbonell. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In Proceedings of SDM, 2010. Google ScholarGoogle ScholarCross RefCross Ref
  21. X. Yi, L. Hong, E. Zhong, N. N. Liu, and S. Rajan. Beyond clicks: Dwell time for personalization. In Proceedings of RecSys 2014, pages 113--120, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. P. Yin, P. Luo, W.-C. Lee, and M. Wang. Silence is also evidence: Interpreting dwell time for recommendation from psychological perspective. In Proceedings of KDD 2013, pages 989--997, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Y. Yue, R. Patel, and H. Roehrig. Beyond position bias: examining result attractiveness as a source of presentation bias in clickthrough data. In Proceedings of WWW 2010, pages 1011--1018, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Y. C. Zhang, D. O. Seaghdha, D. Quercia, and T. Jambor. Aurallist: Introducing serendipity into music recommendation. In Proceedings of WSDM 2012, pages 13--22, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. User Fatigue in Online News Recommendation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      WWW '16: Proceedings of the 25th International Conference on World Wide Web
      April 2016
      1482 pages
      ISBN:9781450341431

      Copyright © 2016 Copyright is held by the International World Wide Web Conference Committee (IW3C2)

      Publisher

      International World Wide Web Conferences Steering Committee

      Republic and Canton of Geneva, Switzerland

      Publication History

      • Published: 11 April 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      WWW '16 Paper Acceptance Rate115of727submissions,16%Overall Acceptance Rate1,899of8,196submissions,23%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader