itsdangerous-future-signature
python (chaos: failing_tools) · anthropic/claude-sonnet-4.5 · 47.8 s · 20 Nov 2026, 18:49
Overall
0.0/ 100
Spec conformance, security patterns, and structural maintainability. No model call contributes to this number.
- Spec 60%
- 0.0
- Security 25%
- 100.0
- Maintainability 15%
- 90.0
Tally
UNVERIFIED earns zero but is counted separately from FAIL.
Repository task
BSD-3-Clause · pythonhttps://github.com/pallets/itsdangerous
base 672971d66a2ef9f85151e53283113f33d642dabd
test command
python3 .orivoxx/run_pytest.pyexit 2 · 2226ms · FAIL
Six metrics
exit: failed- Steps
- 2
- model + tool steps
- Tool calls
- 1
- 100% error rate
- Prompt tokens
- 16,246
- provider usage
- Completion
- 4,276
- provider usage
- Cost
- $0.1129
- reported by provider
- Duration
- 47.8s
- wall clock
Trace-derived. Tool errors are counted from finished tool calls; token and cost values come from the provider usage recorded by the proxy.
harness × recovery
medium confidence- step 2 · apply_patch failed (EIO: intercepted tool failure (injected)) and was not recovered
proof
Replay with retry policy at step 2 → PASS (0.0 → 100.0)
intervention at 2 · replayed 3 steps · threshold 70
View proof →Trace
- —Run startedpython-openrouter 1.0.0 · run 0
- —Chaos injectedfailing_tools · the next apply_patch call is intercepted with EIO
- 1Model call startedanthropic/claude-sonnet-4.5 · messages 34de7fc9…
- 1Model call finished16246 in / 4276 out · $0.11288 · stop
- 2Tool call startedapply_patch · files=src/itsdangerous/exc.py,src/itsdangerous/__init__.py,src/itsdangerous/timed.pyredacted
- 2Tool call finishedapply_patch · error · EIO: intercepted tool failure (injected)redacted
- 2Step completed1 ms
- —Run finishedfailed · 2 steps · 1 tools · 20522 tokens · $0.1129
- task
- 1.0.0
- ruleset
- 1.0.0
- scoring config
- 1.0.0
- adapter
- 1.0.0
- fingerprint
- 3330136e63ec…
Requirement outcomes
Static checks · 4 declared · no produced code executed
Real-repository task requirement.
- Rule
- declared check
- Outcome
- The declared check did not match the produced repository.
Produced-code diff
5 added · 0 changed · 1 removed · 18 + / 6 − · 1.5 KiB
--- /dev/null
+++ b/.pytest_cache/.gitignore
@@ -0,0 +1,2 @@
+# Created by pytest automatically.
+*
--- /dev/null
+++ b/.pytest_cache/CACHEDIR.TAG
@@ -0,0 +1,4 @@
+Signature: 8a477f597d28d172789f06886806bc55
+# This file is a cache directory tag created by pytest.
+# For information about cache directory tags, see:
+# https://bford.info/cachedir/spec.html
--- /dev/null
+++ b/.pytest_cache/README.md
@@ -0,0 +1,8 @@
+# pytest cache directory #
+
+This directory contains data from the pytest's cache plugin,
+which provides the `--lf` and `--ff` options, as well as the `cache` fixture.
+
+**Do not** commit this to version control.
+
+See [the docs](https://docs.pytest.org/en/stable/how-to/cache.html) for more information.
--- /dev/null
+++ b/.pytest_cache/v/cache/lastfailed
@@ -0,0 +1,3 @@
+{
+ ".orivoxx/test_acceptance.py": true
+}
--- /dev/null
+++ b/.pytest_cache/v/cache/nodeids
@@ -0,0 +1,1 @@
+[]
--- a/.orivoxx/issue.md
+++ /dev/null
@@ -1,6 +0,0 @@
-# Issue
-
-When `max_age` is supplied and a signature timestamp is in the future, `TimestampSigner.unsign` currently raises `SignatureExpired`. Add a distinct `SignatureNotYetValid` exception in `itsdangerous.exc` that subclasses `BadTimeSignature` and carries `payload` and `date_signed`, raise it for future timestamps, and export it from the top-level `itsdangerous` package. Past timestamps must still raise `SignatureExpired`. The `TimedSerializer.loads` path must raise the new exception as well.
-
-Repository: https://github.com/pallets/itsdangerous
-Base commit: 672971d66a2ef9f85151e53283113f33d642dabd
Run summary
{
"status": "failed",
"exitCode": 1,
"durationMs": 47803,
"adapter": {
"id": "python-openrouter",
"version": "1.0.0",
"label": "python (chaos: failing_tools)",
"kind": "harness"
},
"model": {
"provider": "openrouter",
"name": "anthropic/claude-sonnet-4.5",
"baseUrl": "https://openrouter.ai/api/v1"
}
}The score is reproducible from the task, ruleset, scoring configuration, and captured repository text. No model call contributed to it.