Gemma 4 E2B vs Llama 3.1 8B

Change models
IndexAll categories, out of 100.
21.9 ±5.5 best
17.9 ±9.6
GapIndex points below the top.
Top
−4.0 · no clear gap
CoverageIndex weight that has results.
90% best
55%
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2026-04
2024-07
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
128K
128K
AgenticMulti-step tasks with tools.
25.3
—
CodingCode writing and repair.
20.5 best
13.9
ReasoningLogic problems and puzzles.
25.6
—
MultimodalTasks with images and text.
16.8
—
KnowledgeFacts and expert knowledge.
22.1 best
14.4
MultilingualTasks in many languages.
5.0
24.8 best
InstructionTasks with strict prompt rules.
24.5
25.1 best
MathMath problems.
—
10.0

Benchmarks

12 shared
Only Gemma 4 E2B: 10Only Llama 3.1 8B: 8
Gemma 4 E2B
Llama 3.1 8B
4.8% best181 / 222
4.3%190 / 222
EuroEval PolishMultilingual
20.2%173 / 209
41.4% best105 / 209
43.3% best183 / 199
27.0%196 / 199
EuroEval SwedishMultilingual
19.3%162 / 195
40.6% best102 / 195
EuroEval GermanMultilingual
12.9%173 / 191
36.6% best95 / 191
19.5%157 / 182
41.1% best103 / 182
EuroEval FrenchMultilingual
24.3%144 / 178
45.9% best95 / 178
EuroEval SpanishMultilingual
14.6%152 / 176
31.3% best110 / 176
EuroEval DutchMultilingual
24.1%146 / 175
43.8% best89 / 175
EuroEval ItalianMultilingual
16.6%148 / 174
38.5% best99 / 174
43.4% best129 / 141
30.4%134 / 141
60.0% best64 / 75
48.3%67 / 75