conftest

conftest

Shared test fixtures for the evaluation framework.

Classes

MockBackend

MockBackend(responses: Optional[Dict[str, str]] = None)

Bases: InferenceBackend

Backend that returns canned responses for testing.

Source code in src/openjarvis/evals/tests/conftest.py

def __init__(self, responses: Optional[Dict[str, str]] = None) -> None:
    self._responses = responses or {}
    self._default_response = "Mock response"
    self._call_count = 0

MockScorer

MockScorer(result: bool = True)

Bases: Scorer

Scorer that always returns a fixed result.

Source code in src/openjarvis/evals/tests/conftest.py

def __init__(self, result: bool = True) -> None:
    self._result = result

MockDataset

MockDataset(records: Optional[list[EvalRecord]] = None)

Bases: DatasetProvider

Dataset that yields fixed records.

Source code in src/openjarvis/evals/tests/conftest.py

def __init__(self, records: Optional[list[EvalRecord]] = None) -> None:
    self._records = records or []