Skip to content

wandb_tracker

wandb_tracker

W&B experiment tracker for the eval framework.

Classes

WandbTracker 

WandbTracker(project: str, entity: str = '', tags: str = '', group: str = '')

Bases: ResultTracker

Streams per-sample metrics to Weights & Biases.

Source code in src/openjarvis/evals/trackers/wandb_tracker.py 
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
def __init__(
    self,
    project: str,
    entity: str = "",
    tags: str = "",
    group: str = "",
) -> None:
    if wandb is None:
        raise ImportError(
            "wandb is not installed. "
            "Install it with: uv sync --extra eval-wandb"
        )
    self._project = project
    self._entity = entity or None
    self._tags: List[str] = [
        t.strip() for t in tags.split(",") if t.strip()
    ] if tags else []
    self._group = group or None
    self._run: Any = None
    self._step = 0