Skip to content

supergpqa

supergpqa

SuperGPQA dataset provider (m-a-p/SuperGPQA).

Adapted from IPW's supergpqa.py dataset loader.

Classes

SuperGPQADataset 

SuperGPQADataset()

Bases: DatasetProvider

SuperGPQA multiple-choice benchmark dataset.

Source code in src/openjarvis/evals/datasets/supergpqa.py 
32
33
def __init__(self) -> None:
    self._records: List[EvalRecord] = []