Touchstone
IMR R&D · local-model capability bench
Home
Leaderboard
Gauntlet
Domains
Models
Showcase
Harnesses
Benches
MdSkills
Live
Reports
Census
Request a run
← Benches
ladder.php.slugify
PHP
gauntlet
An owned ladder bench, graded mechanically against a fixed test.
Solved
21/26
runs passed
Models
25
have attempted
Harnesses
2
scaffolds tried
Runs
(latest per model × harness — solved sorted first)
Model
Harness
Result
Turns
tok/s
Latency
Ctx
When
gpt-oss-120b
baseline
PASS
—
—
—
64k
2026-06-23
gpt-oss-20b
baseline
PASS
—
—
—
64k
2026-06-23
granite-4.1-30b
baseline
PASS
—
—
—
64k
2026-06-23
granite-4.1-8b
baseline
PASS
—
—
—
64k
2026-06-23
llama-3.3-70b
baseline
PASS
—
—
—
64k
2026-06-23
qwen3-next-80b
baseline
PASS
—
—
—
64k
2026-06-23
qwen3.5-4b
baseline
PASS
—
—
—
64k
2026-06-23
qwen3.6-35b-a3b
baseline
PASS
—
—
—
64k
2026-06-29
mistral-small-3.1-24b-instruct-2503
baseline
PASS
—
—
—
64k
2026-06-29
qwen3.5-122b-a10b-cluster
baseline
PASS
—
—
—
64k
2026-06-29
qwen3-235b-a22b-q4-cluster
baseline
PASS
—
—
—
64k
2026-06-30
qwen3-coder-30b
baseline
PASS
—
—
—
64k
2026-07-01
gemma-4-26b-a4b-it
baseline
PASS
—
—
—
64k
2026-07-01
qwen3.6-35b-a3b-or
baseline
PASS
—
—
—
64k
2026-07-01
gemini-2.5-flash-lite
baseline
PASS
—
—
—
64k
2026-07-01
qwen3.6-35b-bf16
baseline
PASS
—
—
—
64k
2026-07-01
qwen3.6-27b
baseline
PASS
—
—
—
64k
2026-07-01
qwen3.6-27b
v1.7.1
PASS
—
—
—
64k
2026-07-02
phi-4
baseline
PASS
—
—
—
64k
2026-07-02
deepseek-r1-32b
baseline
PASS
—
—
—
64k
2026-07-02
claude-sonnet-4.6
baseline
PASS
—
—
—
64k
2026-07-06
qwen3.5-0.8b
baseline
fail
—
—
—
64k
2026-06-23
qwen3.5-2b
baseline
fail
—
—
—
64k
2026-06-23
devstral-small-2-2512
baseline
fail
—
—
—
64k
2026-06-29
deepseek-r1-distill-qwen-32b
baseline
fail
—
—
—
64k
2026-06-30
phi-4-reasoning-plus
baseline
fail
—
—
—
64k
2026-07-02