TaskBoard: owner-scoped project API
Python agent loop (openai/gpt-4o-mini) · openai/gpt-4o-mini · 16.4 s · 18 Nov 2026, 11:26
A critical failure limited the overall score to 49.9.
- Critical spec failure — overall capped at 59.9
- Critical security failure — overall capped at 49.9
Overall
49.9/ 100
Spec conformance, security patterns, and structural maintainability. No model call contributes to this number.
- Spec 60%
- 33.3
- Security 25%
- 66.7
- Maintainability 15%
- 92.5
Tally
UNVERIFIED earns zero but is counted separately from FAIL.
Six metrics
exit: failed- Steps
- 6
- model + tool steps
- Tool calls
- 5
- 20% error rate
- Prompt tokens
- 7,631
- provider usage
- Completion
- 1,003
- provider usage
- Cost
- $0.0017
- reported by provider
- Duration
- 16.4s
- wall clock
Trace-derived. Tool errors are counted from finished tool calls; token and cost values come from the provider usage recorded by the proxy.
harness × recovery
medium confidence- step 2 · write_file → EACCES: permission denied (injected); no retry before exit
No sufficient intervention was found. This cell is rule-matched but not proven.
Trace
- —Run startedpython-openrouter 1.0.0 · run 0
- —Chaos injectedtool_error · one write_file fails with EACCES
- 1Model call startedopenai/gpt-4o-mini · messages b46a59da…
- 1Model call finished1270 in / 59 out · $0.00023 · stop
- 2Model call startedopenai/gpt-4o-mini · messages f1615fb2…
- 2Model call finished1275 in / 281 out · $0.00036 · stop
- 2Tool call startedwrite_file · path=src/app/api/projects/[id]/route.ts bytes=1125redacted
- 2Tool call finishedwrite_file · error · EACCES: permission denied (injected)redacted
- 2Step completed0 ms
- 3Model call startedopenai/gpt-4o-mini · messages 0e528127…
- task
- 1.0.0
- ruleset
- 1.0.0
- scoring config
- 1.0.0
- adapter
- 1.0.0
- fingerprint
- 1456b7c40dbb…
Requirement outcomes
Static checks · 9 declared · no produced code executed
Every request that reads or mutates a project must verify that the authenticated requester is the project owner. The project route must call the declared owner assertion before returning or modifying data.
- Rule
- text_contains · src/app/api/projects/[id]/route.ts contains "assertProjectOwner"
- Outcome
- The declared check did not match the produced repository.
Produced-code diff
2 added · 0 changed · 0 removed · 63 + / 0 − · 1.7 KiB
--- /dev/null
+++ b/src/app/api/tasks/route.ts
@@ -0,0 +1,20 @@
+import { NextApiRequest, NextApiResponse } from 'next';
+import { db } from '../../../lib/db';
+import { getSession } from '../../../lib/session';
+
+export default async function handler(req: NextApiRequest, res: NextApiResponse) {
+ try {
+ const session = await getSession();
+ const userId = session.userId;
+
+ if (req.method === 'GET') {
+ const projects = await db.listProjects();
+ const userProjects = projects.filter(project => project.ownerId === userId);
+ return res.status(200).json(userProjects);
+ }
+
+ return res.status(405).json({ error: 'Method Not Allowed' });
+ } catch (error) {
+ return res.status(500).json({ error: 'Internal Server Error' });
+ }
+}
--- /dev/null
+++ b/src/components/TaskList.tsx
@@ -0,0 +1,43 @@
+import React, { useEffect, useState } from 'react';
+import { db } from '../lib/db';
+
+const TaskList: React.FC = () => {
+ const [tasks, setTasks] = useState([]);
+ const [loading, setLoading] = useState(true);
+ const [error, setError] = useState<string | null>(null);
+
+ useEffect(() => {
+ const fetchTasks = async () => {
+ try {
+ const projects = await db.listProjects();
+ setTasks(projects);
+ } catch (err) {
+ setError('Failed to load tasks');
+ } finally {
+ setLoading(false);
+ }
+ };
+
+ fetchTasks();
+ }, []);
+
+ if (loading) {
+ return <div>Loading...</div>;
+ }
+
+ if (error) {
+ return <div>{error}</div>;
+ }
+
+ return (
+ <ul>
+ {tasks.map(task => (
+ <li key={task.id}>
+ {task.name} (Last updated: {task.updatedAt})
+ </li>
+ ))}
+ </ul>
+ );
+};
+
+export default TaskList;
Run summary
{
"status": "failed",
"exitCode": 1,
"durationMs": 16441,
"adapter": {
"id": "python-openrouter",
"version": "1.0.0",
"label": "Python agent loop (openai/gpt-4o-mini)",
"kind": "harness"
},
"model": {
"provider": "openrouter",
"name": "openai/gpt-4o-mini",
"baseUrl": "https://openrouter.ai/api/v1"
}
}The score is reproducible from the task, ruleset, scoring configuration, and captured repository text. No model call contributed to it.