AllenAI: Olmo 3 7B Instruct

AllenAI: Olmo 3 7B Instruct

allenai · Released Nov 21, 2025 Efficient
Intelligence #266 / 544
31.9 Our Score
Speed #141 / 254
87.3 tokens / sec
Input #184 / 546
$0.100 per 1M tokens
Output #165 / 546
$0.200 per 1M tokens
Context #336 / 546
65,536 tokens

Analysis Summary

AllenAI: Olmo 3 7B Instruct sits in the Efficient tier on our leaderboard, ranked #266 of 544 published models on overall intelligence. At $0.100 input and $0.200 output per 1M tokens, it is among the most expensive on the market. It offers a mid-sized context window.

Editorial notes

Olmo 3 7B Instruct from AllenAI is a small, cheap model with limited reasoning and coding capability across all benchmarks, best suited to lightweight or research tasks only.

Assessed May 5, 2026

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence2.1Technical1.3Value7.5Content2
Intelligence 2.1/10
Technical 1.3/10
Content 2/10
Value 7.5/10

Olmo 3 7B Instruct is a supervised instruction-fine-tuned variant of the Olmo 3 7B base model, optimized for instruction-following, question-answering, and natural conversational dialogue. By leveraging high-quality instruction data and an open training pipeline, it delivers strong performance across everyday NLP tasks while remaining accessible and easy to integrate. Developed by Ai2 under the Apache 2.0 license, the model offers a transparent, community-friendly option for instruction-driven applications.

7B Parameters

Performance Indices

Source: Artificial Analysis

8.2 Intelligence Index
3.4 Coding Index
12.6 Agentic Index
41.3 Math Index

Benchmark Scores

Intelligence

GPQA Diamond 40% Graduate-level scientific reasoning
HLE 5.8% Humanity's Last Exam
MMLU Pro 52.2% Multi-task language understanding
AIME 2025 41.3% Competition mathematics (2025)
SciCode 10.3% Scientific computing

Technical

LiveCodeBench 26.6% Live coding evaluation
τ²-Bench 12.6% Conversational agent benchmark

Content

IFBench 32.8% Instruction following

Benchmark data from Artificial Analysis and Hugging Face

How does AllenAI: Olmo 3 7B Instruct stack up?

Compare side-by-side with other efficient models.

Compare Models

Model Information

OpenRouter ID allenai/olmo-3-7b-instruct
Providerallenai
Release Date November 21, 2025
Context Length65,536 tokens
Max Completion65,536 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.10 $0.000100
Output $0.20 $0.000200