capreolus.benchmark.codesearchnet
¶
Module Contents¶
Classes¶
CodeSearchNetCorpus (config=None, provide=None, share_dependency_objects=False, build=True) |
CodeSearchNet Corpus. [1] |
CodeSearchNetChallenge (config=None, provide=None, share_dependency_objects=False, build=True) |
CodeSearchNet Challenge. [1] |
-
class
capreolus.benchmark.codesearchnet.
CodeSearchNetCorpus
(config=None, provide=None, share_dependency_objects=False, build=True)[source]¶ Bases:
capreolus.benchmark.Benchmark
CodeSearchNet Corpus. [1]
[1] Hamel Husain, Ho-Hsiang Wu, Tiferet Gazit, Miltiadis Allamanis, and Marc Brockschmidt. 2019. CodeSearchNet Challenge: Evaluating the State of Semantic Code Search. arXiv 2019.
-
class
capreolus.benchmark.codesearchnet.
CodeSearchNetChallenge
(config=None, provide=None, share_dependency_objects=False, build=True)[source]¶ Bases:
capreolus.benchmark.Benchmark
CodeSearchNet Challenge. [1] This benchmark can only be used for training (and challenge submissions) because no qrels are provided.
[1] Hamel Husain, Ho-Hsiang Wu, Tiferet Gazit, Miltiadis Allamanis, and Marc Brockschmidt. 2019. CodeSearchNet Challenge: Evaluating the State of Semantic Code Search. arXiv 2019.