TaskBoard: owner-scoped project API
Python agent loop (deepseek/deepseek-chat-v3-0324) · deepseek/deepseek-chat-v3-0324 · 28.5 s · 18 Nov 2026, 11:33
A critical failure limited the overall score to 49.9.
- Critical spec failure — overall capped at 59.9
- Critical security failure — overall capped at 49.9
Overall
49.7/ 100
Spec conformance, security patterns, and structural maintainability. No model call contributes to this number.
- Spec 60%
- 33.3
- Security 25%
- 66.7
- Maintainability 15%
- 87.1
Tally
UNVERIFIED earns zero but is counted separately from FAIL.
Six metrics
exit: failed- Steps
- 7
- model + tool steps
- Tool calls
- 6
- 17% error rate
- Prompt tokens
- 9,192
- provider usage
- Completion
- 1,295
- provider usage
- Cost
- $0.0041
- reported by provider
- Duration
- 28.5s
- wall clock
Trace-derived. Tool errors are counted from finished tool calls; token and cost values come from the provider usage recorded by the proxy.
harness × recovery
high confidence- step 2 · write_file → EACCES: permission denied (injected); no retry before exit
proof
Replay with retry policy at step 2 → PASS (49.7 → 98.3)
intervention at 2 · replayed 6 steps · threshold 70
View proof →Trace
- —Run startedpython-openrouter 1.0.0 · run 0
- —Chaos injectedtool_error · one write_file fails with EACCES
- 1Model call starteddeepseek/deepseek-chat-v3-0324 · messages b46a59da…
- 1Model call finished1303 in / 73 out · $0.00046 · stop
- 2Model call starteddeepseek/deepseek-chat-v3-0324 · messages 7b91b37a…
- 2Model call finished1318 in / 377 out · $0.00081 · stop
- 2Tool call startedwrite_file · path=src/app/api/projects/[id]/route.ts bytes=1546redacted
- 2Tool call finishedwrite_file · error · EACCES: permission denied (injected)redacted
- 2Step completed0 ms
- 3Model call starteddeepseek/deepseek-chat-v3-0324 · messages 0c8c8bed…
- task
- 1.0.0
- ruleset
- 1.0.0
- scoring config
- 1.0.0
- adapter
- 1.0.0
- fingerprint
- 3113baf9bdd6…
Requirement outcomes
Static checks · 9 declared · no produced code executed
Every request that reads or mutates a project must verify that the authenticated requester is the project owner. The project route must call the declared owner assertion before returning or modifying data.
- Rule
- text_contains · src/app/api/projects/[id]/route.ts contains "assertProjectOwner"
- Outcome
- The declared check did not match the produced repository.
Produced-code diff
5 added · 0 changed · 0 removed · 155 + / 0 − · 3.8 KiB
--- /dev/null
+++ b/src/app/api/tasks/route.ts
@@ -0,0 +1,18 @@
+import { NextResponse } from 'next/server';
+import { db } from '@/lib/db';
+import { getSession } from '@/lib/session';
+
+export async function GET() {
+ try {
+ const session = await getSession();
+ const projects = await db.listProjects();
+ const userProjects = projects.filter(project => project.ownerId === session.userId);
+
+ return NextResponse.json(userProjects);
+ } catch (error) {
+ return NextResponse.json(
+ { error: 'Failed to fetch tasks' },
+ { status: 500 }
+ );
+ }
+}
--- /dev/null
+++ b/src/components/TaskList.tsx
@@ -0,0 +1,49 @@
+import { useState, useEffect } from 'react';
+import type { ProjectRecord } from '../lib/db';
+
+export function TaskList() {
+ const [projects, setProjects] = useState<ProjectRecord[]>([]);
+ const [loading, setLoading] = useState(true);
+ const [error, setError] = useState<string | null>(null);
+
+ useEffect(() => {
+ async function fetchProjects() {
+ try {
+ const response = await fetch('/api/tasks');
+ if (!response.ok) {
+ throw new Error('Failed to fetch projects');
+ }
+ const data = await response.json();
+ setProjects(data);
+ } catch (err) {
+ setError(err instanceof Error ? err.message : 'Unknown error');
+ } finally {
+ setLoading(false);
+ }
+ }
+
+ fetchProjects();
+ }, []);
+
+ if (loading) {
+ return <div>Loading projects...</div>;
+ }
+
+ if (error) {
+ return <div>Error: {error}</div>;
+ }
+
+ return (
+ <div>
+ <h2>Your Projects</h2>
+ <ul>
+ {projects.map((project) => (
+ <li key={project.id}>
+ <h3>{project.name}</h3>
+ <p>Last updated: {new Date(project.updatedAt).toLocaleString()}</p>
+ </li>
+ ))}
+ </ul>
+ </div>
+ );
+}
--- /dev/null
+++ b/src/lib/assertProjectOwner.ts
@@ -0,0 +1,16 @@
+import { db } from './db';
+import { getSession } from './session';
+import { UnauthorizedError } from './errors';
+
+export async function assertProjectOwner(projectId: string) {
+ const session = await getSession();
+ const project = await db.getProject(projectId);
+
+ if (!project) {
+ throw new UnauthorizedError('Project not found');
+ }
+
+ if (project.ownerId !== session.userId) {
+ throw new UnauthorizedError('You do not own this project');
+ }
+}
--- /dev/null
+++ b/src/lib/errors.ts
@@ -0,0 +1,45 @@
+export class UnauthorizedError extends Error {
+ constructor() {
+ super("Unauthorized");
+ this.name = "UnauthorizedError";
+ }
+}
+
+export class NotFoundError extends Error {
+ constructor() {
+ super("Not found");
+ this.name = "NotFoundError";
+ }
+}
+
+export class ValidationError extends Error {
+ constructor(message: string) {
+ super(message);
+ this.name = "ValidationError";
+ }
+}
+
+export type ApiErrorResponse = {
+ error: {
+ name: string;
+ message: string;
+ };
+};
+
+export function toApiErrorResponse(error: unknown): ApiErrorResponse {
+ if (error instanceof Error) {
+ return {
+ error: {
+ name: error.name,
+ message: error.message,
+ },
+ };
+ }
+
+ return {
+ error: {
+ name: "InternalError",
+ message: "An unexpected error occurred",
+ },
+ };
+}
--- /dev/null
+++ b/src/lib/types.ts
@@ -0,0 +1,27 @@
+export type ProjectRecord = {
+ id: string;
+ name: string;
+ ownerId: string;
+ updatedAt: string;
+};
+
+export type Task = {
+ id: string;
+ projectId: string;
+ title: string;
+ description: string;
+ status: 'todo' | 'in-progress' | 'done';
+ createdAt: string;
+ updatedAt: string;
+};
+
+export type ApiErrorResponse = {
+ error: {
+ message: string;
+ code: string;
+ };
+};
+
+export type Session = {
+ userId: string;
+};
Run summary
{
"status": "failed",
"exitCode": 1,
"durationMs": 28488,
"adapter": {
"id": "python-openrouter",
"version": "1.0.0",
"label": "Python agent loop (deepseek/deepseek-chat-v3-0324)",
"kind": "harness"
},
"model": {
"provider": "openrouter",
"name": "deepseek/deepseek-chat-v3-0324",
"baseUrl": "https://openrouter.ai/api/v1"
}
}The score is reproducible from the task, ruleset, scoring configuration, and captured repository text. No model call contributed to it.