Touchstone
← Benches

ladder.csharp.edi_segment

C#gauntlet

An owned ladder bench, graded mechanically against a fixed test.

Solved
13/24
runs passed
Models
23
have attempted
Harnesses
2
scaffolds tried

Runs (latest per model × harness — solved sorted first)

ModelHarnessResultTurnstok/sLatencyCtxWhen
gpt-oss-120bbaselinePASS1——64k2026-06-23
llama-3.3-70bbaselinePASS2——64k2026-06-23
mistral-small-3.1-24b-instruct-2503baselinePASS2——64k2026-06-23
qwen3.6-35b-a3bbaselinePASS———64k2026-06-29
qwen3.5-122b-a10b-clusterbaselinePASS———64k2026-06-29
qwen3-235b-a22b-q4-clusterbaselinePASS———64k2026-06-30
granite-4.1-30bbaselinePASS———64k2026-06-30
gemma-4-26b-a4b-itbaselinePASS———64k2026-07-01
qwen3.6-35b-a3b-orbaselinePASS———64k2026-07-01
qwen3.6-35b-bf16baselinePASS———64k2026-07-01
gemini-2.5-flash-litebaselinePASS———64k2026-07-01
qwen3.6-27bbaselinePASS———64k2026-07-01
qwen3.6-27bv1.7.1PASS———64k2026-07-02
gpt-oss-20bbaselinefail4——64k2026-06-23
devstral-small-2-2512baselinefail4——64k2026-06-23
qwen3.5-2bbaselinefail———64k2026-06-30
granite-4.1-8bbaselinefail———64k2026-06-30
qwen3.5-4bbaselinefail———64k2026-06-30
deepseek-r1-distill-qwen-32bbaselinefail———64k2026-06-30
qwen3.5-0.8bbaselinefail———64k2026-07-01
qwen3-coder-30bbaselinefail———64k2026-07-01
qwen3-next-80bbaselinefail———64k2026-07-02
phi-4-reasoning-plusbaselinefail———64k2026-07-02
claude-sonnet-4.6baselinefail———64k2026-07-06