Anthropic: Claude 3 Haiku

Anthropic: Claude 3 Haiku

anthropic · Released Mar 13, 2024
46
Our Score

Claude 3 Haiku is Anthropic's fastest and most compact model for
near-instant responsiveness. Quick and accurate targeted performance.

$0.25 / 1M Input Price
$1.25 / 1M Output Price
200,000 tokens Context Window
4,096 tokens Max Output

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image → Text
TokenizerClaude

Performance Indices

Source: Artificial Analysis

12.3 Intelligence Index
6.7 Coding Index
11 Agentic Index

Benchmark Scores

Evaluations

GPQA Diamond 37.4%
Graduate-level scientific reasoning
HLE 3.9%
Humanity's Last Exam
LiveCodeBench 15.4%
Live coding evaluation
SciCode 18.6%
Scientific computing
MATH 500 39.4%
Mathematical problem-solving
AIME 1%
Competition mathematics
IFBench 36.1%
Instruction following
LCR 21%
Long-context reasoning
TerminalBench Hard 0.8%
Agentic terminal tasks
τ²-Bench 21.1%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID anthropic/claude-3-haiku
Provideranthropic
Model FamilyClaude 3
Release Date March 13, 2024
Context Length200,000 tokens
Max Completion4,096 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.25 $0.000250
Output $1.25 $0.001250

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

99.5%
Avg Uptime
411ms
Best Latency (TTFT)
89 tok/s
Best Throughput
2/3
Active Endpoints
Available via: Amazon Bedrock, Anthropic, Google

Leaderboard Categories