Leaderboard
12 results · score desc, then earliest result
| # | Score | Task | Adapter | Model | Spec | Sec | Maint | Pass@k | Reliability | Flags | Created |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 99.5μ 86.3 · σ 18.7 | taskboard | Fake fixture (taskboard/compliant)Sample | no model | 100.0 | 100.0 | 96.7 | 67% | 3 runs · 67% pass | — | 15 Nov 2026, 15:38 |
| 2 | 99.5μ 86.3 · σ 18.7 | taskboard | Fake fixture (taskboard/compliant)Sample | no model | 100.0 | 100.0 | 96.7 | 67% | 3 runs · 67% pass | — | 18 Nov 2026, 06:08 |
| 3 | 98.1μ 71.7 · σ 26.4 | taskboard | Python agent loop (deepseek/deepseek-chat-v3-0324)Organizer-run | deepseek/deepseek-chat-v3-0324 | 100.0 | 100.0 | 87.1 | 50% | 8 runs · 50% pass | — | 15 Nov 2026, 18:50 |
| 4 | 97.3μ 71.7 · σ 26.4 | taskboard | Python agent loop (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 100.0 | 100.0 | 82.0 | 50% | 8 runs · 50% pass | — | 15 Nov 2026, 18:46 |
| 5 | 97.3 | taskboard | Aider 0.86.2 (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 100.0 | 100.0 | 82.0 | 100% | 1 runs · 100% pass | — | 15 Nov 2026, 18:49 |
| 6 | 96.4μ 71.7 · σ 26.4 | taskboard | Python agent loop (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 100.0 | 100.0 | 76.0 | 50% | 8 runs · 50% pass | — | 18 Nov 2026, 11:15 |
| 7 | 94.9μ 71.7 · σ 26.4 | taskboard | Python agent loop (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 95.2 | 100.0 | 85.0 | 50% | 8 runs · 50% pass | — | 18 Nov 2026, 11:37 |
| 8 | 59.9μ 86.3 · σ 18.7 | taskboard | Fake fixture (taskboard/regressed)Sample | no model | 52.4 | 100.0 | 90.0 | 67% | 3 runs · 67% pass | Capped | 15 Nov 2026, 15:38 |
| 9 | 59.9μ 71.7 · σ 26.4 | taskboard | Python agent loop (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 61.9 | 100.0 | 82.0 | 50% | 8 runs · 50% pass | Capped | 18 Nov 2026, 11:37 |
| 10 | 49.9μ 71.7 · σ 26.4 | taskboard | Python agent loop (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 33.3 | 66.7 | 92.5 | 50% | 8 runs · 50% pass | Capped | 18 Nov 2026, 11:26 |
| 11 | 49.7μ 71.7 · σ 26.4 | taskboard | Python agent loop (deepseek/deepseek-chat-v3-0324)Organizer-run | deepseek/deepseek-chat-v3-0324 | 33.3 | 66.7 | 87.1 | 50% | 8 runs · 50% pass | Capped | 18 Nov 2026, 11:33 |
| 12 | 27.4μ 71.7 · σ 26.4 | taskboard | Python agent loop (openai/gpt-4o-mini)Organizer-run | openai/gpt-4o-mini | 0.0 | 66.7 | 71.7 | 50% | 8 runs · 50% pass | Capped | 18 Nov 2026, 11:16 |
ids: res_1ab24b…662a · res_6d753e…2b41 · res_716261…2fea · res_f74d49…f247 · res_a39c6e…63b4 · res_df4fc5…dd7e · res_186441…167c · res_0e0868…71e1 · res_7607dd…cb71 · res_0427d9…1735 · res_64068a…04a4 · res_6d4fdf…d1fc
A leaderboard-valid row records task, ruleset, scoring-config, and adapter versions plus a repository fingerprint. Rows missing any of them are rejected by the store schema.