skip to main content
10.1145/2187836.2187918acmotherconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

Modeling and predicting behavioral dynamics on the web

Published:16 April 2012Publication History

ABSTRACT

User behavior on the Web changes over time. For example, the queries that people issue to search engines, and the underlying informational goals behind the queries vary over time. In this paper, we examine how to model and predict this temporal user behavior. We develop a temporal modeling framework adapted from physics and signal processing that can be used to predict time-varying user behavior using smoothing and trends. We also explore other dynamics of Web behaviors, such as the detection of periodicities and surprises. We develop a learning procedure that can be used to construct models of users' activities based on features of current and historical behaviors. The results of experiments indicate that by using our framework to predict user behavior, we can achieve significant improvements in prediction compared to baseline models that weight historical evidence the same for all queries. We also develop a novel learning algorithm that explicitly learns when to apply a given prediction model among a set of such models. Our improved temporal modeling of user behavior can be used to enhance query suggestions, crawling policies, and result ranking.

References

  1. Z. Zheng G. Mishne J. Bai R. Zhang K. Bichner C. Liao A. Dong, Y. Chang and F. Diaz. Towards recency ranking in web search. In WSDM, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. E. Adar, D. S. Weld, B. N. Bershad, and S. D. Gribble. Why we search: visualizing and predicting user behavior. In WWW, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. S. M. Beitzel, E. C. Jensen, A. Chowdhury, D. Grossman, and O. Frieder. Hourly analysis of a very large topically categorized web query log. In SIGIR, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. P. N. Bennett, K. Svore, and S. T. Dumais. Classification-enhanced ranking. In WWW, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. S. Chien and N. Immorlica. Semantic similarity between search engine queries using temporal correlation. In WWW, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. D. P. Skinner D. G. Childers and R. C. Kemerait. The cepstrum: A guide to processing.IEEE, 65:1428--1443, 1977.Google ScholarGoogle ScholarCross RefCross Ref
  7. F. Diaz. Integration of news content into web results. In WSDM, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. J. Ginsberg, M. Mohebbi, R. Patel, L. Brammer, M. Smolinski, and L. Brilliant. Detecting influenza epidemics using search engine query data.Nature, 457(7232):1012--4, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  9. J.Durbin and S.Koopman.Time Series Analysis by State Space Methods. Oxford University Press, 2008.Google ScholarGoogle Scholar
  10. R. Jones and F. Diaz. Temporal profiles of queries. ACM Trans. Inf. Syst, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. J. Kleinberg. Bursty and hierarchical structure in streams. In KDD, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. Kleinberg. Temporal dynamics of on-line information systems. Data Stream Management: Processing High-Speed Data Streams. Springer, 2006.Google ScholarGoogle Scholar
  13. Y. Koren. Collaborative filtering with temporal dynamics. In KDD, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. A. Kulkarni, J. Teevan, K. M. Svore, and S. T. Dumais. Understanding temporal query dynamics.Google ScholarGoogle Scholar
  15. J.Ord R. Hyndman, A.Koehler and R.Snyder. Forecasting with Exponential Smoothing (The State Space Approach). Springer, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  16. K. Radinsky, E. Agichtein, E. Gabrilovich, and S. Markovitch. A word at a time: Computing word relatedness using temporal semantic analysis. In WWW, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. K. Radinsky, S. Davidovich, and S. Markovitch. Predicting the news of tomorrow using patterns in web search queries. In WI, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. M. Shokouhi. Detecting seasonal queries by time-series analysis. In SIGIR, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Jan A. Snyman.Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms. Springer, 2005.Google ScholarGoogle Scholar
  20. M. Vlachos, C. Meek, Z. Vagena, and D. Gunopulos. Identifying similarities, periodicities and bursts for online search queries. In SIGMOD, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. P. Wang, M. W. Berry, and Y. Yang. Mining longitudinal web queries: trends and patterns. JASIST, 54:743--758, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. J. Yang and J. Leskovec. Patterns of temporal variation in online media. In WSDM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Modeling and predicting behavioral dynamics on the web

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      WWW '12: Proceedings of the 21st international conference on World Wide Web
      April 2012
      1078 pages
      ISBN:9781450312295
      DOI:10.1145/2187836

      Copyright © 2012 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 16 April 2012

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate1,899of8,196submissions,23%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader