TaskBoard: owner-scoped project API
Python agent loop (openai/gpt-4o-mini) · openai/gpt-4o-mini · 33.9 s · 18 Nov 2026, 11:37
A critical failure limited the overall score to 59.9.
- Critical spec failure — overall capped at 59.9
Overall
59.9/ 100
Spec conformance, security patterns, and structural maintainability. No model call contributes to this number.
- Spec 60%
- 61.9
- Security 25%
- 100.0
- Maintainability 15%
- 82.0
Tally
UNVERIFIED earns zero but is counted separately from FAIL.
Six metrics
exit: completed- Steps
- 6
- model + tool steps
- Tool calls
- 5
- 0% error rate
- Prompt tokens
- 7,631
- provider usage
- Completion
- 971
- provider usage
- Cost
- $0.0017
- reported by provider
- Duration
- 33.9s
- wall clock
Trace-derived. Tool errors are counted from finished tool calls; token and cost values come from the provider usage recorded by the proxy.
spec × detection
medium confidence- step — · REQ-AUTH-001 failed with no trace-level fault; the spec may be misleading
No sufficient intervention was found. This cell is rule-matched but not proven.
Trace
- —Run startedpython-openrouter 1.0.0 · run 0
- —Chaos injectedlatency · 2.5s delay per model call
- 1Model call startedopenai/gpt-4o-mini · messages b46a59da…
- 1Model call finished1270 in / 59 out · $0.00023 · stop
- 2Model call startedopenai/gpt-4o-mini · messages f1615fb2…
- 2Model call finished1275 in / 273 out · $0.00036 · stop
- 2Tool call startedwrite_file · path=src/app/api/projects/[id]/route.ts bytes=1097redacted
- 2Tool call finishedwrite_file · ok · ok bytes=1097redacted
- 2Step completed0 ms
- 3Model call startedopenai/gpt-4o-mini · messages 0e528127…
- task
- 1.0.0
- ruleset
- 1.0.0
- scoring config
- 1.0.0
- adapter
- 1.0.0
- fingerprint
- ec662069436f…
Requirement outcomes
Static checks · 9 declared · no produced code executed
Every request that reads or mutates a project must verify that the authenticated requester is the project owner. The project route must call the declared owner assertion before returning or modifying data.
- Rule
- text_contains · src/app/api/projects/[id]/route.ts contains "assertProjectOwner"
- Outcome
- The declared check did not match the produced repository.
Produced-code diff
3 added · 0 changed · 0 removed · 97 + / 0 − · 2.8 KiB
--- /dev/null
+++ b/src/app/api/projects/[id]/route.ts
@@ -0,0 +1,36 @@
+import { NextApiRequest, NextApiResponse } from 'next';
+import { db } from '@/lib/db';
+import { getSession } from '@/lib/session';
+
+export default async function handler(req: NextApiRequest, res: NextApiResponse) {
+ const {
+ query: { id },
+ method,
+ } = req;
+
+ try {
+ const session = await getSession();
+ const project = await db.getProject(id as string);
+
+ if (!project) {
+ return res.status(404).json({ error: 'Project not found' });
+ }
+
+ if (project.ownerId !== session.userId) {
+ return res.status(403).json({ error: 'Forbidden: You do not own this project' });
+ }
+
+ switch (method) {
+ case 'GET':
+ return res.status(200).json(project);
+ case 'PUT':
+ const { name } = req.body;
+ const updatedProject = await db.updateProject(id as string, { name });
+ return res.status(200).json(updatedProject);
+ default:
+ return res.setHeader('Allow', ['GET', 'PUT']).status(405).end(`Method ${method} Not Allowed`);
+ }
+ } catch (error) {
+ return res.status(500).json({ error: 'Internal Server Error' });
+ }
+}
--- /dev/null
+++ b/src/app/api/tasks/route.ts
@@ -0,0 +1,14 @@
+import { NextResponse } from 'next/server';
+import { db } from '@/lib/db';
+import { getSession } from '@/lib/session';
+
+export async function GET() {
+ try {
+ const session = await getSession();
+ const projects = await db.listProjects();
+ const userProjects = projects.filter(project => project.ownerId === session.userId);
+ return NextResponse.json(userProjects);
+ } catch (error) {
+ return NextResponse.json({ error: 'Failed to fetch projects' }, { status: 500 });
+ }
+}
--- /dev/null
+++ b/src/components/TaskList.tsx
@@ -0,0 +1,47 @@
+import React, { useEffect, useState } from 'react';
+
+const TaskList: React.FC = () => {
+ const [tasks, setTasks] = useState([]);
+ const [loading, setLoading] = useState(true);
+ const [error, setError] = useState<string | null>(null);
+
+ useEffect(() => {
+ const fetchTasks = async () => {
+ try {
+ const response = await fetch('/api/tasks');
+ if (!response.ok) {
+ throw new Error('Failed to fetch tasks');
+ }
+ const data = await response.json();
+ setTasks(data);
+ } catch (err) {
+ setError(err.message);
+ } finally {
+ setLoading(false);
+ }
+ };
+
+ fetchTasks();
+ }, []);
+
+ if (loading) {
+ return <div>Loading tasks...</div>;
+ }
+
+ if (error) {
+ return <div>Error: {error}</div>;
+ }
+
+ return (
+ <div>
+ <h2>Task List</h2>
+ <ul>
+ {tasks.map((task: any) => (
+ <li key={task.id}>{task.name}</li>
+ ))}
+ </ul>
+ </div>
+ );
+};
+
+export default TaskList;
Run summary
{
"status": "completed",
"exitCode": 0,
"durationMs": 33944,
"adapter": {
"id": "python-openrouter",
"version": "1.0.0",
"label": "Python agent loop (openai/gpt-4o-mini)",
"kind": "harness"
},
"model": {
"provider": "openrouter",
"name": "openai/gpt-4o-mini",
"baseUrl": "https://openrouter.ai/api/v1"
}
}The score is reproducible from the task, ruleset, scoring configuration, and captured repository text. No model call contributed to it.