Omar Alonso
Stefano Mizzaro
ABSTRACT
We discuss the concept of relevance criteria in the context of e-Commerce search. A vast body of research literature describes the beyond-topical criteria used to determine the relevance of the document to the need. We argue that in an e-Commerce scenario there are some differences, and novel and different criteria can be used to determine relevance. We experimentally validate this hypothesis by means of Amazon Mechanical Turk using a crowdsourcing approach.
- O. Alonso, D. Rose, and B. Stewart. Crowdsourcing for relevance evaluation. SIGIR Forum, 42(2):9--15, 2008. Google Scholar
Digital Library
- C. L. Barry and L. Schamber. Users' criteria for relevance evaluation: A cross--situational comparison. IP&M, 34(2/3):219--236, 1998. Google ScholarDigital Library
- A. Kittur, E. H. Chi, and B. Suh. Crowdsourcing user studies with Mechanical Turk. In CHI '08: Proceeding of the 26th SIGCHI, pages 453--456, 2008. Google ScholarDigital Library
- S. Mizzaro. Relevance: The whole history. JASIS, 48(9):810--832, 1997. Google ScholarDigital Library
- T. Saracevic. Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: nature and manifestations of relevance. JASIST, 58(13):1915--1933, 2007. Google ScholarDigital Library
- T. Saracevic. Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: behavior and effects of relevance. JASIST, 58(13):2126--2144, 2007. Google ScholarDigital Library
Index Terms
- Relevance criteria for e-commerce: a crowdsourcing-based experimental analysis
Recommendations
User relevance criteria choices and the information search process
Relevance judgments occur within an information search process, where time, context and situation can impact the judgments. The determination of relevance is dependent on a number of factors and variables which include the criteria used to determine ...
Relationships between categories of relevance criteria and stage in task completion
The process of information seeking involves a varied set of tasks and interactions. Exactly how the information seeker judges the relevance of what is retrieved has been a renewed area of interest in information retrieval studies. Various studies have ...
Calibrating information users' views on relevance: A social representations approach
The purpose of this study is to investigate how information users view the concept of relevance and make their judgement(s) on relevant information through the framework of social representations theory. More specifically, this study attempts to address ...
Comments