EleutherAI: Llemma 7b

eleutherai · Released Apr 14, 2025
DFO score #609 / 697
9.0 leaderboard score
Speed
– Not reported
Input Price #509 / 697
$0.800 per 1M tokens
Output Price #401 / 697
$1.20 per 1M tokens
Context #576 / 697
4,096 tokens

Analysis Summary

EleutherAI's Llemma 7B is listed as a text model with a 4,096-token context window. The supplied record contains no benchmark results, pricing advantage, or tool-use details, so its current reasoning and task reliability cannot be assessed here. Its name suggests a mathematics-oriented model, but the provided data does not establish performance on mathematical or coding workloads.

The short context limits its usefulness for lengthy proofs, larger code samples, or document analysis. It may be considered for a small research or evaluation pilot, but there is insufficient evidence to recommend it for client-facing content, production coding, or autonomous workflows. Teams should compare it against current alternatives using task-specific test sets.

Do not deploy it for consequential work without measured validation. Adoption should depend on demonstrated quality on the intended workload, not on its model label.

Assessed September 23, 2026

Editorial notes

Llemma 7B is a text model with a 4K context and no supplied benchmark results; the available data does not establish suitability for production mathematics or coding tasks.

The DFO score ranks models on the Artificial Analysis Intelligence Index and is refreshed as new models launch. The write-up and verdict are our own. Feedback?

DFO Verdict

Llemma 7B is a text model with a 4K context and no supplied benchmark results; the available data does not establish suitability for production mathematics or coding tasks.

#609 of 697 overall Down 1 this week

How EleutherAI: Llemma 7b compares

Its 4K-token context window is larger than 17% of the models we list. At $0.80 per million input tokens it is cheaper than 27% of comparable models.

Position in the field
DFO score: ahead of 13% of models #608
Price: cheaper than 27% of models #509
Context: larger than 17% of models #576
worst in fieldmedianbest in field
Price vs frontier peers · $ per 1M tokens
EleutherAI: Llemma 7b $0.80 in $1.20 out
Anthropic: Claude Opus 5.5 $4.00 in $20.00 out
Anthropic: Claude Sonnet 5.5 $2.00 in $10.00 out
Anthropic: Claude Fable 5.1 $10.00 in $50.00 out

Dark bar = input · light bar = output, scaled to the priciest peer.

Context window vs peers · tokens

1M tokens ≈ 8 full-length novels or ~2,500 pages of business documents in a single request.

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.80 $0.000800
Output $1.20 $0.001200

What would EleutherAI: Llemma 7b cost your business?

Pick the job that looks most like yours, then fine-tune with the sliders. Estimates update live.

A website chatbot handling around 100 customer conversations a day, a few short messages each.

3,000
One request is one message, email, draft or automation call.
1,200 tokens

$3.31/mo EleutherAI: Llemma 7b $0.0011 per request
$31.68/mo Anthropic: Claude Opus 5.5 $0.01 per request
$15.84/mo Anthropic: Claude Sonnet 5.5 · best value $0.0053 per request

Full calculator with 697 models → Price Calculator

DFO AI AUTOMATION

These numbers get smaller with the right architecture.

We route routine calls to cheap models and save EleutherAI: Llemma 7b for the hard ones. Most clients cut their estimate by 60-80%.

Talk to our team

About EleutherAI: Llemma 7b

Llemma 7B is a language model for mathematics. It was initialized with Code Llama 7B weights, and trained on the Proof-Pile-2 for 200B tokens. Llemma models are particularly strong at..

Frequently asked questions about EleutherAI: Llemma 7b

How much does EleutherAI: Llemma 7b cost?

EleutherAI: Llemma 7b costs $0.80 per million input tokens and $1.20 per million output tokens.

What is the context window of EleutherAI: Llemma 7b?

EleutherAI: Llemma 7b has a context window of 4,096 tokens (4K).

Who created EleutherAI: Llemma 7b?

EleutherAI: Llemma 7b is developed by EleutherAI and was released on April 14, 2025.

© 2026 Design for Online Ltd. Registered in England and Wales No. 10328553. VAT Registered. Design for Online® and Forerunner® are registered trademarks.