Claude 3 Haiku vs Gemma 4 E2B
Change modelsClaude 3 HaikuAnthropic
Gemma 4 E2BGoogle
IndexAll categories, out of 100.
22.0 ±5.4 best
21.9 ±5.5
GapIndex points below the top.
Top
−0.1 · no clear gap
CoverageIndex weight that has results.
95% best
90%
SpeedOutput tokens per second.
73/s
—
EloLMArena rating and rank.
1195
—
ReleasedMonth of release.
2024-03
2026-04
Input / 1MUS dollars per 1M input tokens.
$0.25
—
Output / 1MUS dollars per 1M output tokens.
$1.25
—
1K chats2K tokens in, 500 out, each.
$1.13
—
1K documents20K tokens in, 1K out, each.
$6.25
—
1K agent tasks200K tokens in, 20K out, each.
$75.00
—
ContextMaximum tokens in one request.
200K best
128K
AgenticMulti-step tasks with tools.
16.8
25.3 best
CodingCode writing and repair.
31.2 best
20.5
ReasoningLogic problems and puzzles.
31.6 best
25.6
MultimodalTasks with images and text.
5.0
16.8 best
KnowledgeFacts and expert knowledge.
24.1 best
22.1
MultilingualTasks in many languages.
—
5.0
InstructionTasks with strict prompt rules.
22.8
24.5 best
MathMath problems.
8.1
—
Benchmarks
7 sharedOnly Claude 3 Haiku: 5Only Gemma 4 E2B: 15
Claude 3 Haiku
Gemma 4 E2B