Llama 4 Scout 17B 16E Instruct

Llama 4 Scout 17B 16E Instruct is a model from Meta. It has 6 scored results in 4 categories. It has no index.

  • Input: text
UnrankedEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 51.0
CoverageIndex weight that has results.55%
SpeedOutput tokens per second.—Median 67/s
First tokenSeconds to the first output token.—Median 1.3 s
Input / 1MUS dollars per 1M input tokens.—Median $0.60
Output / 1MUS dollars per 1M output tokens.—Median $2.55
ContextMaximum tokens in one request.—Median 262K
EloLMArena rating and rank.1279±5 #278Median 1422

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.1 counted21.3—
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.1 counted31.6—
KnowledgeFacts and expert knowledge.2 counted26.2—
MultilingualTasks in many languages.None counted——
InstructionTasks with strict prompt rules.None counted——
MathMath problems.2 counted25.8—

Results

6 counted
BenchmarkThe benchmark name.ResultThe score from the source.PlacePlace among results on this benchmark.
MATH 500Math79.2% ±1.840 / 59
AIMEMath19.0% ±0.780 / 95
MMLU ProKnowledge69.6% ±0.4120 / 135
MMMU ProMultimodal58.8% ±1.284 / 92
LiveCodeBenchCoding38.5% ±1.0131 / 142
GPQA Diamond · Vals AIKnowledge47.0% ±2.5125 / 135
MGSMMultilingual88.0% ±2.054 / 74
MortgageTaxFinance57.8% ±1.072 / 97
LegalBenchLegal72.0% ±0.5118 / 149
CorpFin v2Finance46.8% ±1.0112 / 131
TaxEval v2Finance55.2% ±1.0137 / 143
MedQAHealthcare50.9% ±0.592 / 95
MedCodeHealthcare23.3% ±1.7103 / 106
MedScribeHealthcare50.6% ±1.9108 / 109

Sources

BenchLMCC BY-NC 4.0Vals AINo licence stated

More from Meta

All models
Muse Wonder Full77.3Muse Wonder73.1Muse Spark 1.370.1Muse Spark Open65.1Muse Spark 1.264.9