skip to main content
research-article

Challenging the long tail recommendation

Published:01 May 2012Publication History
Skip Abstract Section

Abstract

The success of "infinite-inventory" retailers such as Amazon.com and Netflix has been largely attributed to a "long tail" phenomenon. Although the majority of their inventory is not in high demand, these niche products, unavailable at limited-inventory competitors, generate a significant fraction of total revenue in aggregate. In addition, tail product availability can boost head sales by offering consumers the convenience of "one-stop shopping" for both their mainstream and niche tastes. However, most of existing recommender systems, especially collaborative filter based methods, can not recommend tail products due to the data sparsity issue. It has been widely acknowledged that to recommend popular products is easier yet more trivial while to recommend long tail products adds more novelty yet it is also a more challenging task.

In this paper, we propose a novel suite of graph-based algorithms for the long tail recommendation. We first represent user-item information with undirected edge-weighted graph and investigate the theoretical foundation of applying Hitting Time algorithm for long tail item recommendation. To improve recommendation diversity and accuracy, we extend Hitting Time and propose efficient Absorbing Time algorithm to help users find their favorite long tail items. Finally, we refine the Absorbing Time algorithm and propose two entropy-biased Absorbing Cost algorithms to distinguish the variation on different user-item rating pairs, which further enhances the effectiveness of long tail recommendation. Empirical experiments on two real life datasets show that our proposed algorithms are effective to recommend long tail items and outperform state-of-the-art recommendation techniques.

References

  1. D. Agarwal and B.-C. Chen. Regression-based latent factor models. In KDD, pages 19--28, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. D. Agarwal and B.-C. Chen. flda: matrix factorization through latent dirichlet allocation. In WSDM, pages 91--100, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. C. Anderson. The Long Tail: Why the Futhure of Business is Selling Less of More. Hyperion, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. M. Brand. A random walks perspective on maximizing satisfaction and profit. In SDM, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  5. W.-Y. Chen, J.-C. Chu, J. Luan, H. Bai, Y. Wang, and E. Y. Chang. Collaborative filtering for orkut communities: discovery of user latent behavior. In WWW, pages 681--690, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. P. Cremonesi, Y. Koren, and R. Turrin. Performance of recommender algorithms on top-n recommendation tasks. In RecSys, pages 39--46, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. D. M. Fleder and K. Hosanagar. Recommender systems and their impact on sales diversity. In EC, pages 192--199, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. F. Fouss, A. Pirotte, J. Renders, and M. Saerens. A novel way of computing dissimilarities between nodes of a graph, with application to collaborative filtering and subspace projection of the graph nodes. In ECML, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. T. L. Griffiths and M. Steyvers. Finding scientific topics. Proc Natl Acad Sci U S A, pages 5228--35, 2004.Google ScholarGoogle ScholarCross RefCross Ref
  10. Z. Guan, J. Wu, Q. Zhang, A. Singh, and X. Yan. Assessing and ranking structural correlations in graphs. In SIGMOD, pages 937--948, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. T. H. Haveliwala. Topic-sensitive pagerank. In WWW, pages 517--526, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Herlocker, J. A. Konstan, and J. Riedl. An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. Inf. Retr., 5:287--310, October 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. G. Kemeny and J. L. Snell. Finite Markov Chains. Springer-Verlag, 1976.Google ScholarGoogle Scholar
  14. J. Norris. Markov Chains. Cambridge University Press, 1997.Google ScholarGoogle Scholar
  15. Y. Kang and N. Yu. Soft-constraint based online lda for community recommendation. In PCM, pages 494--505, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD, pages 426--434, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. R. Krestel, P. Fankhauser, and W. Nejdl. Latent dirichlet allocation for tag recommendation. In RecSys, pages 61--68, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. L. Lovsz. Random walks on graphs: A survey, 1993.Google ScholarGoogle Scholar
  19. H. Ma, M. R. Lyu, and I. King. Diversifying query suggestion results. In AAAI, 2010.Google ScholarGoogle Scholar
  20. M. R. McLaughlin and J. L. Herlocker. A collaborative filtering algorithm and evaluation metric that accurately model the user experience. In SIGIR, pages 329--336, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. S. M. McNee, J. Riedl, and J. A. Konstan. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In CHI EA, pages 1097--1101, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. D. Oktar. Recommendation Systems: Increasing Profit by Long Tail. http://en.webrazzi.com/2009/09/18/.Google ScholarGoogle Scholar
  23. K. Onuma, H. Tong, and C. Faloutsos. Tangent: a novel, 'surprise me', recommendation algorithm. In KDD, pages 657--666, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. A. G. Parameswaran, G. Koutrika, B. Bercovitz, and H. Garcia-Molina. Recsplorer: recommendation algorithms based on precedence mining. In SIGMOD, pages 87--98, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor. Recommender Systems Handbook. Springer-Verlag New York, Inc., 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. C. E. Shannon. Prediction and entropy of printed english. Bell Systems Technical Journal, 30:50--64, 1951.Google ScholarGoogle ScholarCross RefCross Ref
  27. S. Ross. Stochastic processes, 2nd ed, 1996.Google ScholarGoogle Scholar
  28. M. Steyvers and T. Griffiths. Probabilistic Topic Models. Lawrence Erlbaum Associates, 2007.Google ScholarGoogle Scholar
  29. F. Wang, S. Ma, L. Yang, and T. Li. Recommendation on item graphs. In ICDM, pages 1119--1123, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Challenging the long tail recommendation
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the VLDB Endowment
      Proceedings of the VLDB Endowment  Volume 5, Issue 9
      May 2012
      120 pages

      Publisher

      VLDB Endowment

      Publication History

      • Published: 1 May 2012
      Published in pvldb Volume 5, Issue 9

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader