capreolus.benchmark.antique

Module Contents

Classes

ANTIQUE

A Non-factoid Question Answering Benchmark from Hashemi et al. [1]

Attributes

logger

PACKAGE_PATH

capreolus.benchmark.antique.logger[source]
capreolus.benchmark.antique.PACKAGE_PATH[source]
class capreolus.benchmark.antique.ANTIQUE(config=None, provide=None, share_dependency_objects=False, build=True)[source]

Bases: capreolus.benchmark.Benchmark

A Non-factoid Question Answering Benchmark from Hashemi et al. [1]

[1] Helia Hashemi, Mohammad Aliannejadi, Hamed Zamani, and W. Bruce Croft. 2020. ANTIQUE: A non-factoid question answering benchmark. ECIR 2020.

module_name = antique[source]
dependencies[source]
qrel_file[source]
topic_file[source]
fold_file[source]
query_type = title[source]
relevance_level = 2[source]