Touchstone
← Benches

ladder.csharp.expr_eval

C#gauntlet

An owned ladder bench, graded mechanically against a fixed test.

Solved
6/24
runs passed
Models
23
have attempted
Harnesses
2
scaffolds tried

Runs (latest per model × harness — solved sorted first)

ModelHarnessResultTurnstok/sLatencyCtxWhen
gpt-oss-120bbaselinePASS1——64k2026-06-23
qwen3.6-35b-a3bbaselinePASS———64k2026-06-23
gemma-4-26b-a4b-itbaselinePASS———64k2026-07-01
qwen3.6-27bbaselinePASS———64k2026-07-01
qwen3.6-27bv1.7.1PASS———64k2026-07-02
claude-sonnet-4.6baselinePASS———64k2026-07-06
llama-3.3-70bbaselinefail4——64k2026-06-23
devstral-small-2-2512baselinefail4——64k2026-06-23
mistral-small-3.1-24b-instruct-2503baselinefail4——64k2026-06-23
qwen3.5-122b-a10b-clusterbaselinefail———64k2026-06-29
qwen3-235b-a22b-q4-clusterbaselinefail———64k2026-06-30
qwen3.5-2bbaselinefail———64k2026-06-30
granite-4.1-8bbaselinefail———64k2026-06-30
qwen3.5-4bbaselinefail———64k2026-06-30
deepseek-r1-distill-qwen-32bbaselinefail———64k2026-06-30
granite-4.1-30bbaselinefail———64k2026-06-30
qwen3.5-0.8bbaselinefail———64k2026-07-01
gpt-oss-20bbaselinefail———64k2026-07-01
qwen3-coder-30bbaselinefail———64k2026-07-01
qwen3.6-35b-a3b-orbaselinefail———64k2026-07-01
qwen3.6-35b-bf16baselinefail———64k2026-07-01
gemini-2.5-flash-litebaselinefail———64k2026-07-01
qwen3-next-80bbaselinefail———64k2026-07-02
phi-4-reasoning-plusbaselinefail———64k2026-07-02