Skip to content

dokimi baseline

usage: dokimi baseline [-h] {save,list,compare} ...

positional arguments:
  {save,list,compare}
    save               Save an eval result as a named baseline
    list               List saved baselines
    compare            Compare eval result vs saved baseline

options:
  -h, --help           show this help message and exit

dokimi baseline save

usage: dokimi baseline save [-h] --from-eval FROM_EVAL [--product PRODUCT] [--name NAME]

options:
  -h, --help            show this help message and exit
  --from-eval FROM_EVAL
                        Path to eval JSON file
  --product PRODUCT     Product name (e.g., oneTBB)
  --name NAME           Baseline name (auto-generated if omitted)

dokimi baseline list

usage: dokimi baseline list [-h] [--product PRODUCT]

options:
  -h, --help         show this help message and exit
  --product PRODUCT  Filter by product

dokimi baseline compare

usage: dokimi baseline compare [-h] --eval EVAL [--product PRODUCT] [--baseline BASELINE]
                               [--strict]

options:
  -h, --help           show this help message and exit
  --eval EVAL          Path to current eval JSON file
  --product PRODUCT    Product name for baseline lookup
  --baseline BASELINE  Baseline name (latest if omitted)
  --strict             Exit 1 instead of warning when the baseline's answer or judge model differs
                       from the current eval's