Skip to content

Submit a run

The public path runs the fake baseline: a checked-in fixture materialized through the same capture and scoring pipeline as a real run. It creates a real, immutable result.

Chaos mode tool_error is organizer-executed. The public form creates the deterministic baseline only. Run it from the repository with:pnpm bench:run --task is-email-predicate --adapter python-openrouter --chaos tool_error
1. Task
2. Fixture variant

No model call. The fake baseline materializes a checked-in fixture and scores it deterministically. Real adapter runs are organizer-executed.

What happens next

  1. 1. The fixture is written to an ephemeral workspace.
  2. 2. The workspace is captured, path-checked, redacted, and fingerprinted.
  3. 3. The declared checks run statically against the captured text.
  4. 4. The scorecard is appended to the store and opened in the result explorer.