Gemma 4 26B A4B vs Qwen3.5-4B

Change models
Qwen3.5-4BAlibaba
IndexAll categories, out of 100.
44.5 ±3.9 best
44.3 ±7.4
GapIndex points below the top.
Top
−0.2 · no clear gap
CoverageIndex weight that has results.
100% best
80%
SpeedOutput tokens per second.
—
20/s
EloLMArena rating and rank.
1434
—
ReleasedMonth of release.
2026-04
—
Input / 1MUS dollars per 1M input tokens.
Free
—
Output / 1MUS dollars per 1M output tokens.
Free
—
1K chats2K tokens in, 500 out, each.
Free
—
1K documents20K tokens in, 1K out, each.
Free
—
1K agent tasks200K tokens in, 20K out, each.
Free
—
ContextMaximum tokens in one request.
256K
262K best
AgenticMulti-step tasks with tools.
34.0
63.9 best
CodingCode writing and repair.
45.3
—
ReasoningLogic problems and puzzles.
42.1
43.7 best
MultimodalTasks with images and text.
49.6 best
40.3
KnowledgeFacts and expert knowledge.
46.7 best
41.1
MultilingualTasks in many languages.
36.3 best
35.5
InstructionTasks with strict prompt rules.
56.7 best
37.6
MathMath problems.
56.8 best
41.4

Benchmarks

16 shared
Only Gemma 4 26B A4B: 13
Gemma 4 26B A4B
Qwen3.5-4B
19.3% best114 / 222
9.9%145 / 222
65.7% best134 / 217
63.0%138 / 217
0.0%150 / 214
0.0%150 / 214
EuroEval PolishMultilingual
55.5% best39 / 209
44.2%94 / 209
82.2% best81 / 200
55.8%115 / 200
79.2% best102 / 199
77.1%108 / 199
EuroEval SwedishMultilingual
58.8% best37 / 195
48.9%73 / 195
EuroEval GermanMultilingual
49.1% best43 / 191
39.7%83 / 191
62.0% best24 / 182
48.7%74 / 182
EuroEval FrenchMultilingual
65.2% best25 / 178
51.5%82 / 178
EuroEval SpanishMultilingual
49.4% best45 / 176
36.8%88 / 176
EuroEval DutchMultilingual
56.4% best38 / 175
44.6%85 / 175
EuroEval ItalianMultilingual
61.1% best26 / 174
53.3%52 / 174
43.6%102 / 149
92.1% best35 / 149
72.4% best36 / 146
52.0%78 / 146
69.2% best77 / 113
65.4%82 / 113