knowledge_base

knowledge_base

Knowledge base benchmark dataset.

Document-grounded retrieval questions for evaluating retrieval accuracy and answer correctness from a knowledge corpus.

Classes

KnowledgeBaseDataset

KnowledgeBaseDataset()

Bases: DatasetProvider

Knowledge base benchmark: document-grounded retrieval and QA.

Source code in src/openjarvis/evals/datasets/knowledge_base.py

def __init__(self) -> None:
    self._records: List[EvalRecord] = []