Gemini 1.5 Flash vs Llama 3.1 8B
Change modelsGemini 1.5 FlashGoogle
Llama 3.1 8BMeta
IndexAll categories, out of 100.
20.2 ±9.6 best
17.9 ±9.6
GapIndex points below the top.
Top
−2.3 · no clear gap
CoverageIndex weight that has results.
55%
55%
SpeedOutput tokens per second.
—
—
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2024-05
2024-07
Input / 1MUS dollars per 1M input tokens.
—
—
Output / 1MUS dollars per 1M output tokens.
—
—
1K chats2K tokens in, 500 out, each.
—
—
1K documents20K tokens in, 1K out, each.
—
—
1K agent tasks200K tokens in, 20K out, each.
—
—
ContextMaximum tokens in one request.
1M best
128K
AgenticMulti-step tasks with tools.
—
—
CodingCode writing and repair.
8.3
13.9 best
ReasoningLogic problems and puzzles.
—
—
MultimodalTasks with images and text.
21.6
—
KnowledgeFacts and expert knowledge.
22.3 best
14.4
MultilingualTasks in many languages.
—
24.8
InstructionTasks with strict prompt rules.
—
25.1
MathMath problems.
18.0 best
10.0
Benchmarks
6 sharedOnly Gemini 1.5 Flash: 7Only Llama 3.1 8B: 14
Gemini 1.5 Flash
Llama 3.1 8B