Skip to content

test_types

test_types

Tests for core data types.

Classes

TestRunConfig

Functions
test_metadata_independent 
test_metadata_independent()

Each RunConfig should have its own metadata dict.

Source code in src/openjarvis/evals/tests/test_types.py 
127
128
129
130
131
132
def test_metadata_independent(self):
    """Each RunConfig should have its own metadata dict."""
    c1 = RunConfig(benchmark="a", backend="b", model="m")
    c2 = RunConfig(benchmark="a", backend="b", model="m")
    c1.metadata["key"] = "val"
    assert c2.metadata == {}

TestBenchmarkConfig

Functions
test_tools_list_independent 
test_tools_list_independent()

Each BenchmarkConfig instance should have its own tools list.

Source code in src/openjarvis/evals/tests/test_types.py 
360
361
362
363
364
365
def test_tools_list_independent(self):
    """Each BenchmarkConfig instance should have its own tools list."""
    b1 = BenchmarkConfig(name="a")
    b2 = BenchmarkConfig(name="b")
    b1.tools.append("calc")
    assert b2.tools == []