Gordon V. Cormack
ABSTRACT
Reciprocal Rank Fusion (RRF), a simple method for combining the document rankings from multiple IR systems, consistently yields better results than any individual system, and better results than the standard method Condorcet Fuse. This result is demonstrated by using RRF to combine the results of several TREC experiments, and to build a meta-learner that ranks the LETOR 3 dataset better than any previously reported method
- Cao, Z., Qin, T., Liu, T.-Y., Tsai, M.-F., and Li, H. Learning to rank: from pairwise approach to listwise approach. In ICML ’07 (2007). Google Scholar
Digital Library
- Freund, Y., Iyer, R., Schapire, R. E., and Singer, Y. An efficient boosting algorithm for combining preferences. JMLR 4 (2003). Google ScholarDigital Library
- Joachims, T. Optimizing search engines using clickthrough data. In KDD '02 (2002). Google ScholarDigital Library
- Montague, M., and Aslam, J. A. Condorcet fusion for improved retrieval. In CIKM (2002). Google ScholarDigital Library
- Voorhees, E. M., and Harman, D. K., Eds. TREC -- Experiment and Evaluation in IR. MIT Press, 2005. Google ScholarDigital Library
- Xu, J., and Li, H. Adarank: a boosting algorithm for information retrieval. In SIGIR '07 (2007). Google ScholarDigital Library
Index Terms
- Reciprocal rank fusion outperforms condorcet and individual rank learning methods
Recommendations
Effective rank aggregation for metasearching
Nowadays, mashup services and especially metasearch engines play an increasingly important role on the Web. Most of users use them directly or indirectly to access and aggregate information from more than one data sources. Similarly to the rest of the ...
Rank aggregation model for meta search: an approach using text and rank analysis measures
Intelligent information processing IIOne problem domain of meta search is to combine and improve the precision of ranking results from various search systems. This paper describes a rank aggregation model that incorporates text analysis measure with existing rank-based method, e.g. Best ...
Learning to rank by optimizing expected reciprocal rank
AIRS'11: Proceedings of the 7th Asia conference on Information Retrieval TechnologyLearning to rank is one of the most hot research areas in information retrieval, among which listwise approach is an important research direction and the methods that directly optimizing evaluation metrics in listwise approach have been used for ...
Comments