OpenAI: o1

OpenAI: o1

openai · Released Dec 17, 2024 Specialist
56.7
Our Score

Performance Profile

Intelligence5.6Technical4.5Value5Content6.5
Intelligence 5.6/10
Technical 4.5/10
Content 6.5/10
Value 5/10

The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason using chain of thought. The o1 models are optimized for math, science, programming, and other STEM-related tasks. They consistently exhibit PhD-level accuracy on benchmarks in physics, chemistry, and biology. Learn more in the launch announcement.

$15.00 / 1M
Input Price
$60.00 / 1M
Output Price
200,000 tokens
Context Window
100,000 tokens
Max Output

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image + File → Text
TokenizerGPT

Performance Indices

Source: Artificial Analysis

30.8 Intelligence Index
20.5 Coding Index
37.8 Agentic Index

Benchmark Scores

Intelligence

GPQA Diamond 74.7% Graduate-level scientific reasoning
HLE 7.7% Humanity's Last Exam
MMLU Pro 84.1% Multi-task language understanding
MATH 500 97% Mathematical problem-solving
AIME 72.3% Competition mathematics
SciCode 35.8% Scientific computing

Technical

LiveCodeBench 67.9% Live coding evaluation
TerminalBench Hard 12.9% Agentic terminal tasks
τ²-Bench 62.6% Conversational agent benchmark

Content

IFBench 70.3% Instruction following
LCR 59.3% Long-context reasoning

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID openai/o1
Provideropenai
Model Familyo1
Release Date December 17, 2024
Context Length200,000 tokens
Max Completion100,000 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $15.00 $0.015000
Output $60.00 $0.060000

Leaderboard Categories