SupportFlow
GOAL
The flagship: senior-dev work on a live production app.
WHAT IT TESTS
Real merged bug-fixes in a Laravel ticketing app.
HOW IT GRADES
FAIL->PASS graded by the app's own PHPUnit suite -- fix real issues without breaking anything else.
Standings — gauntlet benches solved
| Model | Solved | |
|---|---|---|
| qwen3.6-35b-a3b | 6/22 | |
| hermes-4.3-36b | 4/22 | |
| gemma-4-26b-a4b-it | 3/22 | |
| qwen3-next-80b | 3/15 | |
| devstral-small-2-2512 | 2/3 |
Benches — green = in gauntlet
sup-pr162sup-pr165sup-pr170sup-pr172sup-pr173sup-pr192sup-pr195sup-pr201sup-pr205sup-pr212sup-pr214sup-pr219sup-pr222sup-pr231sup-pr253sup-pr289sup-pr320sup-pr356sup-pr361sup-pr369sup-pr372sup-pr67sup-pr147sup-pr148sup-pr158sup-pr159sup-pr166sup-pr171sup-pr193sup-pr198sup-pr211sup-pr213sup-pr220sup-pr229sup-pr247sup-pr251sup-pr252sup-pr270sup-pr290sup-pr299sup-pr302sup-pr322sup-pr325sup-pr357sup-pr365sup-pr71sup-pr74sup-pr76