granite-4.1-8b

evaluated

Vendor: IBMQuant: Q8Type: local

Capability starfish

green = capability (pass-rate) · blue = operational (vs roster) · dashed = roster average

Overall

mean domain rate

Solved

38/59

latest per bench

Gauntlet time

~2s/bench

Speed

20.5

tok/s

Steps/bench

1.7

decisiveness

$ / run

—

OpenRouter-equiv

Overall rank

#19 of 26

Agentic

#20 of 22

Coding

#18 of 22

Speed (tok/s)

#14 of 22

Decisive

#12 of 22

Strongest

Gate · 93%

Weakest

Coding · 67%

Where it fits · live, recomputed from current results

#19 of 26 overall; strongest on Gate (93%); weakest on Coding (67%); #14/22 for speed (20.5 tok/s). (auto-generated from current results)

Verdict history · snapshotted daily when it changes

2026-07-08#19 of 26 overall; strongest on Gate (93%); weakest on Coding (67%); #14/22 for speed (20.5 tok/s). (auto-generated from current results)

2026-07-07#22 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (4%); #21/25 on the supportflow gauntlet; #15/26 for speed (16.0 tok/s). (auto-generated from current results)

2026-07-06#21 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (4%); #20/24 on the supportflow gauntlet; #14/26 for speed (16.0 tok/s). (auto-generated from current results)

2026-07-05#21 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (4%); #21/23 on the supportflow gauntlet; #14/26 for speed (16.0 tok/s). (auto-generated from current results)

2026-07-04#21 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (5%); #21/23 on the supportflow gauntlet; #15/26 for speed (15.2 tok/s). (auto-generated from current results)

2026-07-03#21 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (5%); #20/22 on the supportflow gauntlet; #15/26 for speed (15.2 tok/s). (auto-generated from current results)

2026-07-02#17 of 30 overall; strongest on Gate (93%); weakest on SupportFlow (5%); #21/26 on the supportflow gauntlet; #17/29 for speed (15.2 tok/s). (auto-generated from current results)

2026-07-01#15 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (6%); #18/23 on the supportflow gauntlet; #15/27 for speed (13.8 tok/s). (auto-generated from current results)

2026-06-30#14 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (3%); #17/21 on the supportflow gauntlet; #14/27 for speed (16.7 tok/s). (auto-generated from current results)

2026-06-29#13 of 28 overall; strongest on Gate (93%); weakest on SupportFlow (3%); #17/21 on the supportflow gauntlet; #14/27 for speed (16.7 tok/s). (auto-generated from current results)

Domain breakdown

Gate

93%

13/14

Coding

67%

4/6

Agentic

78%

7/9

67%

10/15

PHP

80%

4/5

Benches run

green = passed · red = failed · hover for harness & time

Gate (14)

Coding (6)

Agentic (9)

C# (15)

PHP (5)

SWE (10)

History (monthly pass-rate)

2026-06

83%

177/214

Availability record

When this model appeared in our catalogue census.

2026-06-25 · openrouter