Anthropic: Claude 3.5 Haiku

Anthropic: Claude 3.5 Haiku

anthropic · Released Nov 4, 2024
53
Our Score

Claude 3.5 Haiku features offers enhanced capabilities in speed, coding accuracy, and tool use. Engineered to excel in real-time applications, it delivers quick response times that are essential for dynamic tasks such as chat interactions and immediate coding suggestions. This makes it highly suitable for environments that demand both speed and precision, such as software development, customer service bots, and data management systems. This model is currently pointing to Claude 3.5 Haiku (2024-10-22).

$0.80 / 1M Input Price
$4.00 / 1M Output Price
200,000 tokens Context Window
8,192 tokens Max Output

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image → Text
TokenizerClaude

Performance Indices

Source: Artificial Analysis

18.7 Intelligence Index
10.7 Coding Index
13.5 Agentic Index

Benchmark Scores

Evaluations

GPQA Diamond 40.8%
Graduate-level scientific reasoning
HLE 3.5%
Humanity's Last Exam
MMLU Pro 63.4%
Multi-task language understanding
LiveCodeBench 31.4%
Live coding evaluation
SciCode 27.4%
Scientific computing
MATH 500 72.1%
Mathematical problem-solving
AIME 3.3%
Competition mathematics
IFBench 42.8%
Instruction following
LCR 23.3%
Long-context reasoning
TerminalBench Hard 2.3%
Agentic terminal tasks
τ²-Bench 24.6%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID anthropic/claude-3.5-haiku
Provideranthropic
Model FamilyClaude 3.5
Release Date November 4, 2024
Context Length200,000 tokens
Max Completion8,192 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.80 $0.000800
Output $4.00 $0.004000

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
682ms
Best Latency (TTFT)
40 tok/s
Best Throughput
1/3
Active Endpoints
Available via: Amazon Bedrock, Google

Leaderboard Categories