EleutherAI: Llemma 7b

EleutherAI: Llemma 7b

eleutherai · Released Apr 14, 2025 Legacy
Intelligence #531 / 576
20.0 Our Score
Speed
— Not reported
Input #419 / 576
$0.800 per 1M tokens
Output #336 / 576
$1.20 per 1M tokens
Context #449 / 576
4,096 tokens

Analysis Summary

Llemma 7b is a small, math-focused language model from EleutherAI, originally designed for mathematical reasoning tasks. With a 4,096-token context window and no published benchmark data in this evaluation, its practical capability for general business use cannot be assessed.

The model's narrow specialisation and tiny context window make it unsuitable for most business workflows, including content generation, coding assistance, or agentic tasks. Even for mathematical use cases, the absence of benchmark evidence and the availability of far more capable models at comparable or lower cost make it difficult to recommend.

At $0.80 input and $1.20 output per million tokens, the pricing is not competitive given the limitations. Businesses with specific mathematical research needs may find academic value in the model, but for commercial deployment it is not a practical choice.

Assessed June 6, 2026

Editorial notes

EleutherAI Llemma 7b is a specialised math language model with no published benchmark data, a 4K context window, and pricing that does not reflect its limited scope.

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence0Technical0Value6.3Content2.5
Intelligence 0/10
Technical 0/10
Content 2.5/10
Value 6.3/10

How EleutherAI: Llemma 7b compares

Its 4K-token context window is larger than 22% of the models we list. At $0.80 per million input tokens it is cheaper than 27% of comparable models.

About EleutherAI: Llemma 7b

Llemma 7B is a language model for mathematics. It was initialized with Code Llama 7B weights, and trained on the Proof-Pile-2 for 200B tokens. Llemma models are particularly strong at..

7B Parameters

Architecture Detail

Instruct Typecode-llama

How does EleutherAI: Llemma 7b stack up?

Compare side-by-side with other legacy models.

Compare Models

Model Information

OpenRouter ID eleutherai/llemma_7b
Providereleutherai
Release Date April 14, 2025
Context Length4,096 tokens
Max Completion4,096 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.80 $0.000800
Output $1.20 $0.001200

Frequently asked questions about EleutherAI: Llemma 7b

How much does EleutherAI: Llemma 7b cost?

EleutherAI: Llemma 7b costs $0.80 per million input tokens and $1.20 per million output tokens.

What is the context window of EleutherAI: Llemma 7b?

EleutherAI: Llemma 7b has a context window of 4,096 tokens (4K).

Who created EleutherAI: Llemma 7b?

EleutherAI: Llemma 7b is developed by EleutherAI and was released on April 14, 2025.