Touchstone
← Benches

ladder.csharp.parse_amount

C#gauntlet

An owned ladder bench, graded mechanically against a fixed test.

Solved
14/24
runs passed
Models
23
have attempted
Harnesses
2
scaffolds tried

Runs (latest per model × harness — solved sorted first)

ModelHarnessResultTurnstok/sLatencyCtxWhen
gpt-oss-120bbaselinePASS1——64k2026-06-23
llama-3.3-70bbaselinePASS1——64k2026-06-23
qwen3.6-35b-a3bbaselinePASS———64k2026-06-29
qwen3-235b-a22b-q4-clusterbaselinePASS———64k2026-06-30
granite-4.1-30bbaselinePASS———64k2026-06-30
gpt-oss-20bbaselinePASS———64k2026-07-01
qwen3-coder-30bbaselinePASS———64k2026-07-01
gemma-4-26b-a4b-itbaselinePASS———64k2026-07-01
qwen3.6-35b-a3b-orbaselinePASS———64k2026-07-01
qwen3.6-35b-bf16baselinePASS———64k2026-07-01
qwen3.6-27bbaselinePASS———64k2026-07-01
qwen3.6-27bv1.7.1PASS———64k2026-07-02
qwen3-next-80bbaselinePASS———64k2026-07-02
claude-sonnet-4.6baselinePASS———64k2026-07-06
devstral-small-2-2512baselinefail4——64k2026-06-23
mistral-small-3.1-24b-instruct-2503baselinefail4——64k2026-06-23
qwen3.5-122b-a10b-clusterbaselinefail———64k2026-06-29
qwen3.5-2bbaselinefail———64k2026-06-30
granite-4.1-8bbaselinefail———64k2026-06-30
qwen3.5-4bbaselinefail———64k2026-06-30
deepseek-r1-distill-qwen-32bbaselinefail———64k2026-06-30
qwen3.5-0.8bbaselinefail———64k2026-07-01
gemini-2.5-flash-litebaselinefail———64k2026-07-01
phi-4-reasoning-plusbaselinefail———64k2026-07-02