OpenAI: GPT-4o (2024-08-06)

OpenAI: GPT-4o (2024-08-06)

openai · Released Aug 6, 2024
52
Our Score

The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of GPT-4 Turbo while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities. For benchmarking against other models, it was briefly called "im-also-a-good-gpt2-chatbot"

$2.50 / 1M Input Price
$10.00 / 1M Output Price
128,000 tokens Context Window
16,384 tokens Max Output

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image + File → Text
TokenizerGPT

Performance Indices

Source: Artificial Analysis

18.6 Intelligence Index
16.6 Coding Index
18.6 Agentic Index

Benchmark Scores

Evaluations

GPQA Diamond 52.1%
Graduate-level scientific reasoning
HLE 2.9%
Humanity's Last Exam
LiveCodeBench 31.7%
Live coding evaluation
SciCode 33.1%
Scientific computing
MATH 500 79.5%
Mathematical problem-solving
AIME 11.7%
Competition mathematics
IFBench 36%
Instruction following
LCR 35%
Long-context reasoning
TerminalBench Hard 8.3%
Agentic terminal tasks
τ²-Bench 28.9%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID openai/gpt-4o-2024-08-06
Provideropenai
Model FamilyGPT-4o
Release Date August 6, 2024
Context Length128,000 tokens
Max Completion16,384 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $2.50 $0.002500
Output $10.00 $0.010000

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
349ms
Best Latency (TTFT)
33 tok/s
Best Throughput
2/2
Active Endpoints
Available via: Azure, OpenAI

Leaderboard Categories