Jingjing Liu
Nicholas J. Belkin
ABSTRACT
Dwell time as a user behavior has been found in previous studies to be an unreliable predictor of document usefulness, with contextual factors such as the user's task needing to be considered in its interpretation. Task stage has been shown to influence search behaviors including usefulness judgments, as has task type. This paper reports on an investigation of how task stage and task type may help predict usefulness from the time that users spend on retrieved documents, over the course of several information seeking episodes. A 3-stage controlled experiment was conducted with 24 participants, each coming 3 times to work on 3 sub-tasks of a general task, couched either as "parallel" or "dependent" task type. The full task was to write a report on the general topic, with interim documents produced for each sub-task. Results show that task stage can help in inferring document usefulness from decision time, especially in the parallel task. The findings can be used to increase accuracy in predicting document usefulness and accordingly in personalizing search for multi-session tasks.
- Belkin, N.J. (2008). Some(What) grand challenges for information retrieval. ACM SIGIR Forum 42, 1, 47--54. Google Scholar
Digital Library
- Byström, K., & Järvelin, K. (1995). Task complexity affects information seeking and use. Inform Process Manag, 31, 191--213. Google ScholarDigital Library
- Freund (2008). Exploring task-document relations in support of information retrieval in the workplace. Unpublished Dissertation. University of Toronto.Google Scholar
- Ingwersen, P. & Järvelin, K. (2005). The turn: Integration of information seeking and retrieval in context. Springer-Verlag New York, Inc. Secaucus, NJ, USA. Google Scholar
- Kellar, M., Watters, C., & Shepherd, M. (2007). A field study characterizing Web-based information-seeking tasks. J. Am. Soc. Inf. Sci. Tec., 58(7), 999--1018. Google ScholarDigital Library
- Kelly, D. & Belkin, N.J. (2004). Display time as implicit feedback: Understanding task effects. Proc. SIGIR, 377--384. Google ScholarDigital Library
- Kuhlthau, C.C. (1991). Inside the search process: information seeking from the user's perspective. J. Am. Soc. Inf. Sci., 42, 361--371.Google ScholarCross Ref
- Li, Y. & Belkin, N.J. (2008). A faceted approach to conceptualizing tasks in information seeking. Inform Process Manag, 44, 1822--1837. Google ScholarDigital Library
- Lin, S.-J. (2001). Modeling and Supporting Multiple Information Seeking Episodes over the Web. Unpublished dissertation. Rutgers University.Google Scholar
- Tang, R., Shaw, W.M., & Vevea, J.L. (1999). Towards the identification of the optimal number of relevance categories. J. Am. Soc. Inf. Sci. Tec, 50(3), 254--264. Google ScholarDigital Library
- Taylor, R.S. (1968). Question negotiation and information seeking in libraries. College & Research Libraries, 29, 178--194.Google ScholarCross Ref
- Taylor, A. R., Cool, C., Belkin, N.J., & Amadio, W.J. (2007). Relationships between categories of relevance criteria and stage in task completion. Inform Process Manag 43, 1071--1084. Google ScholarDigital Library
- Toms, E., MacKenzie, T., Jordan, C., O'Brien, H., Freund, L., Toze, S., et al. (2007). How task affects information search. In Workshop Pre-proceedings in Initiative for the Evaluation of XML Retrieval (INEX), 337--341.Google Scholar
- Vakkari, P., & Hakala, N. (2000). Changes in relevance criteria and problem stages in task performance. J. Doc. 56(5), 540--562.Google ScholarCross Ref
- Vakkari, P., Pennanen, M., & Serola, S. (2003). Changes of search terms and tactics while writing a research proposal: A longitudinal research. Inform Process Manag, 39, 445--463. Google ScholarDigital Library
- Vakkari, P. H., N. (2000). Changes in relevance criteria and problem stages in task performance. J. Doc., 56(5), 540--562.Google ScholarCross Ref
- White, R., & Kelly, D. (2006). A study of the effects of personalization and task information on implicit feedback performance. Proc. CIKM, 297--306. Google ScholarDigital Library
- White, R.W., Ruthven, I., & Jose, J.M. (2005). A study of factors affecting the utility of implicit relevance feedback. Proc. SIGIR, 35--42. Google ScholarDigital Library
Index Terms
- Personalizing information retrieval for multi-session tasks: the roles of task stage and task type
Recommendations
Search behaviors in different task types
JCDL '10: Proceedings of the 10th annual joint conference on Digital librariesPersonalization of information retrieval tailors search towards individual users to meet their particular information needs by taking into account information about users and their contexts, often through implicit sources of evidence such as user ...
Predicting task difficulty for different task types
ASIS&T '10: Proceedings of the 73rd ASIS&T Annual Meeting on Navigating Streams in an Information Ecosystem - Volume 47This paper reports our investigation of differences in users' behavior between difficult and easy search tasks, as well as how these differences vary with different types of tasks. We also report how behavioral predictors of task difficulty vary across ...
Personalizing information retrieval using task features, topic knowledge, and task product
SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrievalPersonalization of information retrieval tailors search towards individual users to meet their particular information needs. Personalization systems obtain additional information about users and their contexts beyond the queries they submit to the ...
Comments