Change search
ReferencesLink to record
Permanent link

Direct link
Evaluation of retrieval effectiveness with incomplete relevance data: theoretical and experimental comparison of three measures
University of Borås, Swedish School of Library and Information Science.
2008 (English)In: Information Processing & Management, ISSN 0306-4573, E-ISSN 1873-5371, Vol. 44, no 1, 212-225 p.Article in journal (Refereed)
Abstract [en]

This paper investigates two relatively new measures of retrieval effectiveness in relation to the problem of incomplete relevance data. The measures, Bpref and RankEff, which do not take into account documents that have not been relevance judged, are compared theoretically and experimentally. The experimental comparisons involve a third measure, the well-known mean uninterpolated average precision. The results indicate that RankEff is the most stable of the three measures when the amount of relevance data is reduced, with respect to system ranking and absolute values. In addition, RankEff has the lowest error-rate.

Place, publisher, year, edition, pages
Elsevier Ltd , 2008. Vol. 44, no 1, 212-225 p.
National Category
Information Studies
URN: urn:nbn:se:hb:diva-2387DOI: 10.1016/j.ipm.2007.01.011Local ID: 2320/3314OAI: diva2:870478
Available from: 2015-11-13 Created: 2015-11-13

Open Access in DiVA

fulltext(552 kB)23 downloads
File information
File name FULLTEXT01.pdfFile size 552 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Ahlgren, Per
By organisation
Swedish School of Library and Information Science
In the same journal
Information Processing & Management
Information Studies

Search outside of DiVA

GoogleGoogle Scholar
Total: 23 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 45 hits
ReferencesLink to record
Permanent link

Direct link