Skip to content

Leaderboard

9 results · score desc, then earliest result

Benchmark leaderboard
#ScoreTaskAdapterModelSpecSecMaintPass@kReliabilityFlagsCreated
198.1μ 71.7 · σ 26.4taskboard
Python agent loop (deepseek/deepseek-chat-v3-0324)Organizer-run
deepseek/deepseek-chat-v3-0324100.0100.087.150%

8 runs · 50% pass

—15 Nov 2026, 18:50
297.3μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini100.0100.082.050%

8 runs · 50% pass

—15 Nov 2026, 18:46
397.3taskboard
Aider 0.86.2 (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini100.0100.082.0100%

1 runs · 100% pass

—15 Nov 2026, 18:49
496.4μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini100.0100.076.050%

8 runs · 50% pass

—18 Nov 2026, 11:15
594.9μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini95.2100.085.050%

8 runs · 50% pass

—18 Nov 2026, 11:37
659.9μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini61.9100.082.050%

8 runs · 50% pass

Capped18 Nov 2026, 11:37
749.9μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini33.366.792.550%

8 runs · 50% pass

Capped18 Nov 2026, 11:26
849.7μ 71.7 · σ 26.4taskboard
Python agent loop (deepseek/deepseek-chat-v3-0324)Organizer-run
deepseek/deepseek-chat-v3-032433.366.787.150%

8 runs · 50% pass

Capped18 Nov 2026, 11:33
927.4μ 71.7 · σ 26.4taskboard
Python agent loop (openai/gpt-4o-mini)Organizer-run
openai/gpt-4o-mini0.066.771.750%

8 runs · 50% pass

Capped18 Nov 2026, 11:16

ids: res_716261…2fea · res_f74d49…f247 · res_a39c6e…63b4 · res_df4fc5…dd7e · res_186441…167c · res_7607dd…cb71 · res_0427d9…1735 · res_64068a…04a4 · res_6d4fdf…d1fc

A leaderboard-valid row records task, ruleset, scoring-config, and adapter versions plus a repository fingerprint. Rows missing any of them are rejected by the store schema.