Skip to content

Resilience testing

Four chaos modes and what each one tests.

  • tool_error — one write fails with EACCES; tests recovery and retry policy
  • failing_tools — the real-task apply_patch call is intercepted; the replay retries it and re-runs the real test
  • latency — every model call is delayed; tests the stopping policy and budget guards
  • context_pressure — context is truncated and the step budget shrinks; tests completeness and detection

Chaos injections are labelled ground truth. The attribution engine is measured against those labels; precision (the proof crosses the threshold) and recall (the expected cell is named) are reported separately in the build log.