Gemma 4 12B vs Solar Pro 3

Change models
Solar Pro 3Upstage
IndexAll categories, out of 100.
39.0 ±4.0
39.2 ±7.9 best
GapIndex points below the top.
−0.2 · no clear gap
Top
CoverageIndex weight that has results.
100% best
75%
SpeedOutput tokens per second.
—
114/s
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2026-06
2026-01
Input / 1MUS dollars per 1M input tokens.
—
$0.15
Output / 1MUS dollars per 1M output tokens.
—
$0.60
1K chats2K tokens in, 500 out, each.
—
$0.60
1K documents20K tokens in, 1K out, each.
—
$3.60
1K agent tasks200K tokens in, 20K out, each.
—
$42.00
ContextMaximum tokens in one request.
256K best
131K
AgenticMulti-step tasks with tools.
30.5
47.0 best
CodingCode writing and repair.
43.5 best
29.1
ReasoningLogic problems and puzzles.
41.5 best
33.2
MultimodalTasks with images and text.
36.2
—
KnowledgeFacts and expert knowledge.
41.5 best
37.4
MultilingualTasks in many languages.
29.7
—
InstructionTasks with strict prompt rules.
57.7 best
48.4
MathMath problems.
41.1
—

Benchmarks

7 shared
Only Gemma 4 12B: 21Only Solar Pro 3: 3
Gemma 4 12B
Solar Pro 3
15.7% best126 / 222
10.3%144 / 222
63.7% best137 / 217
32.3%176 / 217
0.0%150 / 214
0.0%150 / 214
75.3% best115 / 199
72.4%131 / 199
36.3%108 / 149
86.3% best51 / 149
73.5% best28 / 146
71.2%39 / 146
0.0%101 / 133
0.0%101 / 133