Skip to content
res_c1ba8d7b435e4ae6b514138458fab8b7Organizer-runfailedtest failedfailing_tools

itsdangerous-future-signature

python (chaos: failing_tools) · anthropic/claude-sonnet-4.5 · 47.8 s · 20 Nov 2026, 18:49

Compare

Overall

0.0/ 100

Spec conformance, security patterns, and structural maintainability. No model call contributes to this number.

Spec 60%
0.0
Security 25%
100.0
Maintainability 15%
90.0

Tally

3 passed1 failed0 drifted0 unverified

UNVERIFIED earns zero but is counted separately from FAIL.

Repository task

BSD-3-Clause · python

https://github.com/pallets/itsdangerous

base 672971d66a2ef9f85151e53283113f33d642dabd

test command

python3 .orivoxx/run_pytest.py

exit 2 · 2226ms · FAIL

Six metrics

exit: failed
Steps
2
model + tool steps
Tool calls
1
100% error rate
Prompt tokens
16,246
provider usage
Completion
4,276
provider usage
Cost
$0.1129
reported by provider
Duration
47.8s
wall clock

Trace-derived. Tool errors are counted from finished tool calls; token and cost values come from the provider usage recorded by the proxy.

Attributed

harness × recovery

medium confidence
rule: patch_apply_failed_unhandled
  • step 2 · apply_patch failed (EIO: intercepted tool failure (injected)) and was not recovered

proof

Replay with retry policy at step 2 → PASS (0.0 → 100.0)

intervention at 2 · replayed 3 steps · threshold 70

View proof →

Trace

  1. —Run startedpython-openrouter 1.0.0 · run 0
  2. —Chaos injectedfailing_tools · the next apply_patch call is intercepted with EIO
  3. 1Model call startedanthropic/claude-sonnet-4.5 · messages 34de7fc9…
  4. 1Model call finished16246 in / 4276 out · $0.11288 · stop
  5. 2Tool call startedapply_patch · files=src/itsdangerous/exc.py,src/itsdangerous/__init__.py,src/itsdangerous/timed.pyredacted
  6. 2Tool call finishedapply_patch · error · EIO: intercepted tool failure (injected)redacted
  7. 2Step completed1 ms
  8. —Run finishedfailed · 2 steps · 1 tools · 20522 tokens · $0.1129
task
1.0.0
ruleset
1.0.0
scoring config
1.0.0
adapter
1.0.0
fingerprint
3330136e63ec…

Requirement outcomes

Static checks · 4 declared · no produced code executed

  • Real-repository task requirement.

    Rule
    declared check
    Outcome
    The declared check did not match the produced repository.

Produced-code diff

5 added · 0 changed · 1 removed · 18 + / 6 − · 1.5 KiB

unified diff
--- /dev/null
+++ b/.pytest_cache/.gitignore
@@ -0,0 +1,2 @@
+# Created by pytest automatically.
+*
--- /dev/null
+++ b/.pytest_cache/CACHEDIR.TAG
@@ -0,0 +1,4 @@
+Signature: 8a477f597d28d172789f06886806bc55
+# This file is a cache directory tag created by pytest.
+# For information about cache directory tags, see:
+#	https://bford.info/cachedir/spec.html
--- /dev/null
+++ b/.pytest_cache/README.md
@@ -0,0 +1,8 @@
+# pytest cache directory #
+
+This directory contains data from the pytest's cache plugin,
+which provides the `--lf` and `--ff` options, as well as the `cache` fixture.
+
+**Do not** commit this to version control.
+
+See [the docs](https://docs.pytest.org/en/stable/how-to/cache.html) for more information.
--- /dev/null
+++ b/.pytest_cache/v/cache/lastfailed
@@ -0,0 +1,3 @@
+{
+  ".orivoxx/test_acceptance.py": true
+}
--- /dev/null
+++ b/.pytest_cache/v/cache/nodeids
@@ -0,0 +1,1 @@
+[]
--- a/.orivoxx/issue.md
+++ /dev/null
@@ -1,6 +0,0 @@
-# Issue
-
-When `max_age` is supplied and a signature timestamp is in the future, `TimestampSigner.unsign` currently raises `SignatureExpired`. Add a distinct `SignatureNotYetValid` exception in `itsdangerous.exc` that subclasses `BadTimeSignature` and carries `payload` and `date_signed`, raise it for future timestamps, and export it from the top-level `itsdangerous` package. Past timestamps must still raise `SignatureExpired`. The `TimedSerializer.loads` path must raise the new exception as well.
-
-Repository: https://github.com/pallets/itsdangerous
-Base commit: 672971d66a2ef9f85151e53283113f33d642dabd

Run summary

run record
{
  "status": "failed",
  "exitCode": 1,
  "durationMs": 47803,
  "adapter": {
    "id": "python-openrouter",
    "version": "1.0.0",
    "label": "python (chaos: failing_tools)",
    "kind": "harness"
  },
  "model": {
    "provider": "openrouter",
    "name": "anthropic/claude-sonnet-4.5",
    "baseUrl": "https://openrouter.ai/api/v1"
  }
}

The score is reproducible from the task, ruleset, scoring configuration, and captured repository text. No model call contributed to it.