Eugene Agichtein
ABSTRACT
The top web search result is crucial for user satisfaction with the web search experience. We argue that the importance of the relevance at the top position necessitates special handling of the top web search result for some queries. We propose an effective approach of leveraging millions of past user interactions with a web search engine to automatically detect "best bet" top results preferred by majority of users. Interestingly, this problem can be more effectively addressed with classification than using state-of-the-art general ranking methods. Furthermore, we show that our general machine learning approach achieves precision comparable to a heavily tuned, domain-specific algorithm, with significantly higher coverage. Our experiments over millions of user interactions for thousands of queries demonstrate the effectiveness and robustness of our techniques.
- E. Agichtein, E. Brill, S. Dumais, and R. Ragno, Learning User Interaction Models for Predicting Web Search Result Preferences, in the Proceedings of SIGIR, 2006 Google Scholar
Digital Library
- E. Agichtein, E. Brill, and S. T. Dumais, Improving Web Search Ranking by Incorporating User Behavior Information, in the Proceedings of SIGIR, 2006 Google ScholarDigital Library
- R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval, Addison-Wesley, 1999. Google ScholarDigital Library
- S. Brin and L. Page, The Anatomy of a Large-scale Hypertextual Web Search Engine, in the Proceedings of WWW, 1997 Google ScholarDigital Library
- A. Broder, A taxonomy of web search, SIGIR Forum, 2002 Google ScholarDigital Library
- C. J. C. Burges, T. Shaked, E. Renshaw, A. Lazier, M. Deeds, N. Hamilton, G. Hullender, Learning to Rank using Gradient Descent, in the Proceedings of ICML, 2005 Google ScholarDigital Library
- D. M. Chickering, The WinMine Toolkit, Microsoft Technical Report MSR-TR-2002-103, 2002Google Scholar
- M. Claypool, D. Brown, P. Lee and M. Waseda. Inferring user interest. IEEE Internet Computing, 2001 Google ScholarDigital Library
- S. Fox, K. Karnawat, M. Mydland, S. T. Dumais and T. White. Evaluating implicit measures to improve the search experience.ACM TOIS, 2005 Google ScholarDigital Library
- J. Goecks and J. Shavlick. Learning users' interests by unobtrusively observing their normal behavior. In the Proceedings of the IJCAI Workshop on Machine Learning for Information Filtering. 1999.Google Scholar
- T. Joachims, Optimizing Search Engines Using Clickthrough Data, in the Proceedings ofSIGKDD, 2002 Google ScholarDigital Library
- T. Joachims, L. Granka, B. Pang, H. Hembrooke, and G. Gay, Accurately Interpreting Clickthrough Data as Implicit Feedback, in the Proceedings of SIGIR, 2005 Google ScholarDigital Library
- Kelly, D. and Teevan, J., Implicit feedback for inferring user preference: A bibliography. In SIGIR Forum, 2003 Google ScholarDigital Library
- U. Lee, Z. Liu, J. Cho, Automatic Identification of User Goals in Web Search,In Proceedings WWW, 2005 Google ScholarDigital Library
- M. Morita, and Y. Shinoda, Information filtering based on user behavior analysis and best match text retrieval. In Proceedings of SIGIR, 1994 Google ScholarDigital Library
- D. Oard and J. Kim. Implicit feedback for recommender systems. In the Proceedings of the AAAI Workshop on Recommender Systems. 1998Google Scholar
- D. Oard and J. Kim. Modeling information content using observable behavior. In Proceedings of the 64th Annual Meeting of the American Society for Information Science and Technology. 2001Google Scholar
- F. Radlinski and T. Joachims, Query Chains: Learning to Rank from Implicit Feedback, Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD), ACM, 2005. Google ScholarDigital Library
- D. E. Rose and D. Levinson, Understanding user goals in web search, In Proceedings of WWW 2004 Google ScholarDigital Library
- G. Salton & M. McGill. Introduction to modern information retrieval. McGraw-Hill, 1983 Google ScholarDigital Library
- X. Shen, C. Zhai, Active Feedback in Ad Hoc Information Retrieval, in Proceedings of SIGIR, 2005 Google ScholarDigital Library
- X. Shen, B. Tan, C. Zhai, Context-Sensitive Information Retrieval with Implicit Feedback, in Proceedings of SIGIR, 2005 Google ScholarDigital Library
- E. M. Voorhees, D. Harman, Overview of TREC, 2001Google Scholar
- G. R. Xue, H. J. Zeng, Z. Chen, Y. Yu, W. Y. Ma, W. S. Xi, and W. G. Fan, Optimizing web search using web click-through data, in Proceedings of CIKM, 2004 Google ScholarDigital Library
Index Terms
- Identifying "best bet" web search results by mining past user behavior
Recommendations
Improving web search ranking by incorporating user behavior information
SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrievalWe show that incorporating user behavior data can significantly improve ordering of top results in real web search setting. We examine alternatives for incorporating feedback into the ranking process and explore the contributions of user feedback ...
Web search enhancement by mining user actions
Search engines are among the most popular as well as useful services on the web. There is a need, however, to cater to the preferences of the users when supplying the search results to them. We propose to maintain the search profile of each user, on the ...
User Behavior Modeling for Web Image Search
WSDM '19: Proceedings of the Twelfth ACM International Conference on Web Search and Data MiningWeb-based image search engines differ from Web search engines greatly. The intents or goals behind human interactions with image search engines are different. In image search, users mainly search images instead of Web pages or online services. It is ...
Comments