Skip to content

Leaderboard

12 results · score desc, then earliest result

Benchmark leaderboard
#ScoreTaskAdapterModelSpecSecMaintPass@kReliabilityFlagsCreated
199.5μ 86.3 · σ 18.7taskboard
Fake fixture (taskboard/compliant)Sample
no model100.0100.096.767%

3 runs · 67% pass

—15 Nov 2026, 15:38
299.5μ 86.3 · σ 18.7taskboard
Fake fixture (taskboard/compliant)Sample
no model100.0100.096.767%

3 runs · 67% pass

—18 Nov 2026, 06:08
398.1μ 71.7 · σ 26.4taskboard
Python agent loop (deepseek/deepseek-chat-v3-0324)Organizer-run
deepseek/deepseek-chat-v3-0324100.0100.087.150%

8 runs · 50% pass

—15 Nov 2026, 18:50
497.3μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini100.0100.082.050%

8 runs · 50% pass

—15 Nov 2026, 18:46
597.3taskboard
Aider 0.86.2 (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini100.0100.082.0100%

1 runs · 100% pass

—15 Nov 2026, 18:49
696.4μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini100.0100.076.050%

8 runs · 50% pass

—18 Nov 2026, 11:15
794.9μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini95.2100.085.050%

8 runs · 50% pass

—18 Nov 2026, 11:37
859.9μ 86.3 · σ 18.7taskboard
Fake fixture (taskboard/regressed)Sample
no model52.4100.090.067%

3 runs · 67% pass

Capped15 Nov 2026, 15:38
959.9μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini61.9100.082.050%

8 runs · 50% pass

Capped18 Nov 2026, 11:37
1049.9μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini33.366.792.550%

8 runs · 50% pass

Capped18 Nov 2026, 11:26
1149.7μ 71.7 · σ 26.4taskboard
Python agent loop (deepseek/deepseek-chat-v3-0324)Organizer-run
deepseek/deepseek-chat-v3-032433.366.787.150%

8 runs · 50% pass

Capped18 Nov 2026, 11:33
1227.4μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini0.066.771.750%

8 runs · 50% pass

Capped18 Nov 2026, 11:16

ids: res_1ab24b…662a · res_6d753e…2b41 · res_716261…2fea · res_f74d49…f247 · res_a39c6e…63b4 · res_df4fc5…dd7e · res_186441…167c · res_0e0868…71e1 · res_7607dd…cb71 · res_0427d9…1735 · res_64068a…04a4 · res_6d4fdf…d1fc

A leaderboard-valid row records task, ruleset, scoring-config, and adapter versions plus a repository fingerprint. Rows missing any of them are rejected by the store schema.