Mistral Small 3.1 24B Base

Mistral Small 3.1 24B Base is a model from Mistral. It has 1 scored result in 1 category. It has no index.

  • Input: text
UnrankedEnough results for an index.
IndexAll categories, out of 100.UnrankedMedian 51.0
CoverageIndex weight that has results.5%
SpeedOutput tokens per second.—Median 67/s
First tokenSeconds to the first output token.—Median 1.3 s
Input / 1MUS dollars per 1M input tokens.—Median $0.60
Output / 1MUS dollars per 1M output tokens.—Median $2.55
ContextMaximum tokens in one request.—Median 262K
EloLMArena rating and rank.—Median 1422

Capabilities

Index per category, out of 100.
Out of 100
AgenticMulti-step tasks with tools.None counted——
CodingCode writing and repair.None counted——
ReasoningLogic problems and puzzles.None counted——
MultimodalTasks with images and text.None counted——
KnowledgeFacts and expert knowledge.None counted——
MultilingualTasks in many languages.1 counted49.5—
InstructionTasks with strict prompt rules.None counted——
MathMath problems.None counted——

Results

1 counted
BenchmarkThe benchmark name.ResultThe score from the source.PlacePlace among results on this benchmark.
EuroEval GermanMultilingual53.2% ±0.525 / 191
EuroEval PortugueseMultilingual60.8% ±0.426 / 182
EuroEval PolishMultilingual56.3% ±0.434 / 209
EuroEval FrenchMultilingual62.1% ±0.431 / 178
EuroEval ItalianMultilingual58.2% ±0.533 / 174
EuroEval DutchMultilingual57.2% ±0.535 / 175
EuroEval SwedishMultilingual56.6% ±0.445 / 195
EuroEval SpanishMultilingual48.2% ±0.353 / 176

Sources

BenchLMCC BY-NC 4.0EuroEvalMIT

More from Mistral

All models
Mistral Large 460.7Mistral Medium 3.5 128B50.3Mistral Medium 3.542.7Mistral Small 437.9Mistral Large 334.3