diffir.measure.qrels

Module Contents

Classes

QrelMeasure

class diffir.measure.qrels.QrelMeasure(metric='ndcg_20', topk=5)[source]

Bases: diffir.measure.Measure

module_name = qrel[source]
convert_to_nested_dict(self, ir_measures_iterator)[source]

Util method to convert the results from ir_measures.iter_calc to a dict. TODO: We can probably refactor so that this method won’t be needed