ladder.php.template_render

PHPgauntlet

An owned ladder bench, graded mechanically against a fixed test.

Solved

23/26

runs passed

Models

have attempted

Harnesses

scaffolds tried

Runs (latest per model × harness — solved sorted first)

Model	Harness	Result	Turns	tok/s	Latency	Ctx	When
gpt-oss-120b	baseline	PASS	—	—	—	64k	2026-06-23
gpt-oss-20b	baseline	PASS	—	—	—	64k	2026-06-23
granite-4.1-30b	baseline	PASS	—	—	—	64k	2026-06-23
granite-4.1-8b	baseline	PASS	—	—	—	64k	2026-06-23
llama-3.3-70b	baseline	PASS	—	—	—	64k	2026-06-23
qwen3-next-80b	baseline	PASS	—	—	—	64k	2026-06-23
qwen3.5-4b	baseline	PASS	—	—	—	64k	2026-06-23
qwen3.6-35b-a3b	baseline	PASS	—	—	—	64k	2026-06-29
devstral-small-2-2512	baseline	PASS	—	—	—	64k	2026-06-29
mistral-small-3.1-24b-instruct-2503	baseline	PASS	—	—	—	64k	2026-06-29
qwen3.5-122b-a10b-cluster	baseline	PASS	—	—	—	64k	2026-06-29
qwen3-235b-a22b-q4-cluster	baseline	PASS	—	—	—	64k	2026-06-30
qwen3-coder-30b	baseline	PASS	—	—	—	64k	2026-07-01
gemma-4-26b-a4b-it	baseline	PASS	—	—	—	64k	2026-07-01
qwen3.6-35b-a3b-or	baseline	PASS	—	—	—	64k	2026-07-01
gemini-2.5-flash-lite	baseline	PASS	—	—	—	64k	2026-07-01
qwen3.6-35b-bf16	baseline	PASS	—	—	—	64k	2026-07-01
qwen3.6-27b	baseline	PASS	—	—	—	64k	2026-07-01
qwen3.6-27b	v1.7.1	PASS	—	—	—	64k	2026-07-02
phi-4	baseline	PASS	—	—	—	64k	2026-07-02
deepseek-r1-32b	baseline	PASS	—	—	—	64k	2026-07-02
phi-4-reasoning-plus	baseline	PASS	—	—	—	64k	2026-07-02
claude-sonnet-4.6	baseline	PASS	—	—	—	64k	2026-07-06
qwen3.5-0.8b	baseline	fail	—	—	—	64k	2026-06-23
qwen3.5-2b	baseline	fail	—	—	—	64k	2026-06-23
deepseek-r1-distill-qwen-32b	baseline	fail	—	—	—	64k	2026-06-30