TaskBoard: owner-scoped project API
Python agent loop (openai/gpt-4o-mini) · openai/gpt-4o-mini · 6.8 s · 18 Nov 2026, 11:16
A critical failure limited the overall score to 49.9.
- Critical spec failure — overall capped at 59.9
- Critical security failure — overall capped at 49.9
Overall
27.4/ 100
Spec conformance, security patterns, and structural maintainability. No model call contributes to this number.
- Spec 60%
- 0.0
- Security 25%
- 66.7
- Maintainability 15%
- 71.7
Tally
UNVERIFIED earns zero but is counted separately from FAIL.
Six metrics
exit: failed- Steps
- 2
- model + tool steps
- Tool calls
- 1
- 100% error rate
- Prompt tokens
- 2,573
- provider usage
- Completion
- 344
- provider usage
- Cost
- $0.0005
- reported by provider
- Duration
- 6.8s
- wall clock
Trace-derived. Tool errors are counted from finished tool calls; token and cost values come from the provider usage recorded by the proxy.
harness × recovery
medium confidence- step 2 · write_file → EACCES: permission denied (injected); no retry before exit
No sufficient intervention was found. This cell is rule-matched but not proven.
Trace
- —Run startedpython-openrouter 1.0.0 · run 0
- —Chaos injectedtool_error · one write_file fails with EACCES
- 1Model call startedopenai/gpt-4o-mini · messages b46a59da…
- 1Model call finished1270 in / 71 out · $0.00015 · stop
- 2Model call startedopenai/gpt-4o-mini · messages afbb11d0…
- 2Model call finished1303 in / 273 out · $0.00036 · stop
- 2Tool call startedwrite_file · path=src/app/api/projects/[id]/route.ts bytes=1097redacted
- 2Tool call finishedwrite_file · error · EACCES: permission denied (injected)redacted
- 2Step completed0 ms
- —Run finishedfailed · 2 steps · 1 tools · 2917 tokens · $0.0005
- task
- 1.0.0
- ruleset
- 1.0.0
- scoring config
- 1.0.0
- adapter
- 1.0.0
- fingerprint
- 74cf4054d506…
Requirement outcomes
Static checks · 9 declared · no produced code executed
Every request that reads or mutates a project must verify that the authenticated requester is the project owner. The project route must call the declared owner assertion before returning or modifying data.
- Rule
- text_contains · src/app/api/projects/[id]/route.ts contains "assertProjectOwner"
- Outcome
- The declared check did not match the produced repository.
Produced-code diff
0 added · 0 changed · 0 removed · 0 + / 0 − · 0 B
The produced repository is identical to the starting repository.
Run summary
{
"status": "failed",
"exitCode": 1,
"durationMs": 6785,
"adapter": {
"id": "python-openrouter",
"version": "1.0.0",
"label": "Python agent loop (openai/gpt-4o-mini)",
"kind": "harness"
},
"model": {
"provider": "openrouter",
"name": "openai/gpt-4o-mini",
"baseUrl": "https://openrouter.ai/api/v1"
}
}The score is reproducible from the task, ruleset, scoring configuration, and captured repository text. No model call contributed to it.