Inference
EN
Google

Gemma 2 27B

Gemma 2 27B is a standard model from Google. It has 4 scored results in 2 categories. It has no index.

  • Open weights
  • Standard
  • Input: text
  • Released 2024-06
UnrankedEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 51.0
CoverageIndex weight that has results.25%
SpeedOutput tokens per second.—Median 67/s
First tokenSeconds to the first output token.—Median 1.3 s
Input / 1MUS dollars per 1M input tokens.—Median $0.60
Output / 1MUS dollars per 1M output tokens.—Median $2.55
ContextMaximum tokens in one request.8KMedian 262K
EloLMArena rating and rank.—Median 1422

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.None counted——
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.None counted——
KnowledgeFacts and expert knowledge.2 counted16.6—
MultilingualTasks in many languages.None counted——
InstructionTasks with strict prompt rules.None counted——
MathMath problems.2 counted11.1—

Results

4 counted
BenchmarkThe benchmark name.ResultThe score from the source.PlacePlace among results on this benchmark.
MATH level 5Math27.9% ±1.063 / 88
Massive Multitask Language UnderstandingKnowledge76.2%28 / 34
GPQA diamond · Epoch AIKnowledge36.5% ±2.4181 / 217
OTIS Mock AIME 2024-2025Math1.4% ±0.9189 / 200
LegalBenchLegal68.0% ±0.7132 / 149

Sources

BenchLMCC BY-NC 4.0Epoch AICC BY

Questions

What is the context window of Gemma 2 27B?
8K tokens.
Is Gemma 2 27B open source?
Yes. Its weights are published.
When was Gemma 2 27B released?
June 2024.

More from Google

All models
Gemini 1.5 Flash20.2Gemini 1.5 ProUnrankedGemini 1.0 ProUnrankedGemini 2.0 Flash29.5Gemini 2.0 Flash-LiteUnranked