Now showing items 1-3 of 3
Correlation, prediction and ranking of evaluation metrics in information retrieval
(Springer Verlag, 2019)
Given limited time and space, IR studies often report few evaluation metrics which must be carefully selected. To inform such selection, we first quantify correlation between 23 popular IR metrics on 8 TREC test collections. ...
TOBB-ETU at CLEF 2019: Prioritizing claims based on check-worthiness
In recent years, we witnessed an incredible amount of misinformation spread over the Internet. However, it is extremely time consuming to analyze the veracity of every claim made on the Internet. Thus, we urgently need ...
Constructing Test Collections using Multi-armed Bandits and Active Learning
( Association for Computing Machinery, Inc, 2019)
While test collections provide the cornerstone of system-based evaluation in information retrieval, human relevance judging has become prohibitively expensive as collections have grown ever larger. Consequently, intelligently ...