Anthropic: Claude 3.5 Haiku

Anthropic: Claude 3.5 Haiku

anthropic · Released Nov 4, 2024 Specialist
Intelligence #128 / 525
52.1 Our Score
AA Index #163 / 353
18.7 Artificial Analysis
Input #384 / 525
$0.800 per 1M tokens
Output #410 / 525
$4.00 per 1M tokens
Context #146 / 525
200,000 tokens

Analysis Summary

Anthropic: Claude 3.5 Haiku sits in the Specialist tier on our leaderboard, ranked #128 of 525 published models on overall intelligence. At $0.800 input and $4.00 output per 1M tokens, it is among the most expensive on the market. It offers a generous context window for extended reasoning and code review and supports tool use, function calling, and vision.

Editorial notes

Claude 3.5 Haiku is Anthropic's lightweight multimodal model with vision support, a 200K context window, and solid instruction-following — making it a capable option for content tasks on a budget. However, its reasoning and coding benchmarks are modest, limiting its appeal for more demanding business workflows.

Assessed April 23, 2026

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence3.5Technical2.1Value7Content5
Intelligence 3.5/10
Technical 2.1/10
Content 5/10
Value 7/10

Claude 3.5 Haiku features offers enhanced capabilities in speed, coding accuracy, and tool use. Engineered to excel in real-time applications, it delivers quick response times that are essential for dynamic..

Capabilities

Tool Use Function Calling Vision

Performance Indices

Source: Artificial Analysis

18.7 Intelligence Index
10.7 Coding Index
13.5 Agentic Index

Benchmark Scores

Intelligence

GPQA Diamond 40.8% Graduate-level scientific reasoning
HLE 3.5% Humanity's Last Exam
MMLU Pro 63.4% Multi-task language understanding
MATH 500 72.1% Mathematical problem-solving
AIME 3.3% Competition mathematics
SciCode 27.4% Scientific computing

Technical

LiveCodeBench 31.4% Live coding evaluation
TerminalBench Hard 2.3% Agentic terminal tasks
τ²-Bench 24.6% Conversational agent benchmark

Content

IFBench 42.8% Instruction following
LCR 23.3% Long-context reasoning

Benchmark data from Artificial Analysis and Hugging Face

How does Anthropic: Claude 3.5 Haiku stack up?

Compare side-by-side with other specialist models.

Compare Models

Model Information

OpenRouter ID anthropic/claude-3.5-haiku
Provideranthropic
Model FamilyClaude 3.5
Release Date November 4, 2024
Context Length200,000 tokens
Max Completion8,192 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.80 $0.000800
Output $4.00 $0.004000

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
864ms
Best Latency (TTFT)
41 tok/s
Best Throughput
1/3
Active Endpoints
Available via: Amazon Bedrock, Google

Leaderboard Categories