OpenAI: o1

OpenAI: o1

openai · Released Dec 17, 2024
67
Our Score

The latest and strongest model family from OpenAI, o1 is designed to spend more time thinking before responding. The o1 model series is trained with large-scale reinforcement learning to reason using chain of thought. The o1 models are optimized for math, science, programming, and other STEM-related tasks. They consistently exhibit PhD-level accuracy on benchmarks in physics, chemistry, and biology. Learn more in the launch announcement.

$15.00 / 1M Input Price
$60.00 / 1M Output Price
200,000 tokens Context Window
100,000 tokens Max Output

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image + File → Text
TokenizerGPT

Performance Indices

Source: Artificial Analysis

30.8 Intelligence Index
20.5 Coding Index
37.8 Agentic Index

Benchmark Scores

Evaluations

GPQA Diamond 74.7%
Graduate-level scientific reasoning
HLE 7.7%
Humanity's Last Exam
MMLU Pro 84.1%
Multi-task language understanding
LiveCodeBench 67.9%
Live coding evaluation
SciCode 35.8%
Scientific computing
MATH 500 97%
Mathematical problem-solving
AIME 72.3%
Competition mathematics
IFBench 70.3%
Instruction following
LCR 59.3%
Long-context reasoning
TerminalBench Hard 12.9%
Agentic terminal tasks
τ²-Bench 62.6%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID openai/o1
Provideropenai
Model Familyo1
Release Date December 17, 2024
Context Length200,000 tokens
Max Completion100,000 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $15.00 $0.015000
Output $60.00 $0.060000

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

10,154ms
Best Latency (TTFT)
104 tok/s
Best Throughput
0/1
Active Endpoints
Available via: OpenAI

Leaderboard Categories