Benchmark-Qwen-Ref: v0.21.12
Full end-to-end rerun after scoping the DSW package proxy to verifier dependency egress only: Release -> DSW SWE-bench Verified (500) -> Terminal-Bench 2.0 (89) -> same Release publication.
SWE-bench Verified
- Status: QUARANTINED
- Dataset:
swe-bench/swe-bench-verified@2; 500/500 completed - Results: 293 resolved, 123 unresolved, 3 execution errors, 81 infrastructure failures
- Score: not published (non-scoreable or quarantined run)
- Score denominator: valid grader results (293 + 123 = 416)
- Qwen Code:
v0.21.12(b965d5f8c24f); modelqwen3.7-plus - Run:
pool-8d03378ba2724d3b; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/31922258423 - Case trajectories:
swe-bench-verified-dsw-eas-full-20260816-r3-trajectories.tar.gz(421 cases)
Terminal-Bench 2.0
- Status: QUARANTINED
- Dataset:
terminal-bench@2.0; 89/89 completed - Results: 1 resolved, 14 unresolved, 29 execution errors, 45 infrastructure failures
- Score: not published (non-scoreable or quarantined run)
- Score denominator: valid grader results (1 + 14 = 15)
- Qwen Code:
v0.21.12(b965d5f8c24f); modelqwen3.7-plus - Run:
pool-57a2e6a1dc41426d; dispatch workflow: https://github.com/QwenLM/qwen-code/actions/runs/31922258423 - Case trajectories:
terminal-bench-2.0-dsw-eas-full-20260816-r3-trajectories.tar.gz(17 cases)