LFM2.5-24B-A2B vs LFM3-1.7B

Change models
LFM2.5-24B-A2BLiquidAI
LFM3-1.7BLiquidAI
IndexAll categories, out of 100.
39.8 ±7.9
41.5 ±6.5 best
GapIndex points below the top.
−1.7 · no clear gap
Top
CoverageIndex weight that has results.
70%
75% best
SpeedOutput tokens per second.
280/s best
218/s
EloLMArena rating and rank.
—
—
ReleasedMonth of release.
2026-10
2026-10
Input / 1MUS dollars per 1M input tokens.
$0.05 best
$0.08
Output / 1MUS dollars per 1M output tokens.
$0.70
$0.20 best
1K chats2K tokens in, 500 out, each.
$0.45
$0.26 best
1K documents20K tokens in, 1K out, each.
$1.70 best
$1.80
1K agent tasks200K tokens in, 20K out, each.
$24.00
$20.00 best
ContextMaximum tokens in one request.
128K
262K best
AgenticMulti-step tasks with tools.
32.0
46.4 best
CodingCode writing and repair.
38.7 best
37.0
ReasoningLogic problems and puzzles.
—
43.5
MultimodalTasks with images and text.
—
—
KnowledgeFacts and expert knowledge.
38.6 best
28.8
MultilingualTasks in many languages.
—
—
InstructionTasks with strict prompt rules.
58.4 best
57.6
MathMath problems.
45.6
—

Benchmarks

11 shared
Only LFM2.5-24B-A2B: 2Only LFM3-1.7B: 14
LFM2.5-24B-A2B
LFM3-1.7B
74.4% best84 / 141
63.4%107 / 141
51.0% best95 / 114
43.4%106 / 114
74.4% best69 / 84
63.4%76 / 84
7.4% best75 / 77
7.2%76 / 77
96.8% best1 / 70
96.7%2 / 70
74.7% best30 / 57
73.0%36 / 57
32.7% best28 / 35
28.5%32 / 35
27.7%29 / 32
41.3% best19 / 32
8.0%31 / 32
68.0% best9 / 32
65.0%12 / 26
71.4% best8 / 26
26.8%
38.4%