AllenAI: Olmo 3 7B Think

AllenAI: Olmo 3 7B Think

allenai · Released Nov 21, 2025 Efficient
Intelligence #252 / 544
33.9 Our Score
Speed #147 / 254
82.3 tokens / sec
Input #216 / 546
$0.120 per 1M tokens
Output #165 / 546
$0.200 per 1M tokens
Context #336 / 546
65,536 tokens

Analysis Summary

AllenAI: Olmo 3 7B Think sits in the Efficient tier on our leaderboard, ranked #252 of 544 published models on overall intelligence. At $0.120 input and $0.200 output per 1M tokens, it is among the most expensive on the market. It offers a mid-sized context window.

Editorial notes

Olmo 3 7B Think from AllenAI offers slightly better math performance than its instruct sibling but remains weak on reasoning and coding, with minimal agentic capability.

Assessed May 5, 2026

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence2.5Technical1.3Value7.5Content2.5
Intelligence 2.5/10
Technical 1.3/10
Content 2.5/10
Value 7.5/10

Olmo 3 7B Think is a research-oriented language model in the Olmo family designed for advanced reasoning and instruction-driven tasks. It excels at multi-step problem solving, logical inference, and maintaining coherent conversational context. Developed by Ai2 under the Apache 2.0 license, Olmo 3 7B Think supports transparent, fully open experimentation and provides a lightweight yet capable foundation for academic research and practical NLP workflows.

7B Parameters

Performance Indices

Source: Artificial Analysis

9.4 Intelligence Index
7.6 Coding Index
0.8 Agentic Index
70.7 Math Index

Benchmark Scores

Intelligence

GPQA Diamond 51.6% Graduate-level scientific reasoning
HLE 5.7% Humanity's Last Exam
MMLU Pro 65.5% Multi-task language understanding
AIME 2025 70.7% Competition mathematics (2025)
SciCode 21.2% Scientific computing

Technical

LiveCodeBench 61.7% Live coding evaluation
TerminalBench Hard 0.8% Agentic terminal tasks

Content

IFBench 41.5% Instruction following

Benchmark data from Artificial Analysis and Hugging Face

How does AllenAI: Olmo 3 7B Think stack up?

Compare side-by-side with other efficient models.

Compare Models

Model Information

OpenRouter ID allenai/olmo-3-7b-think
Providerallenai
Release Date November 21, 2025
Context Length65,536 tokens
Max Completion65,536 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.12 $0.000120
Output $0.20 $0.000200