Anthropic: Claude 3.5 Haiku

Anthropic: Claude 3.5 Haiku

anthropic · Released Nov 4, 2024 Specialist
Intelligence #128 / 557
53.8 Our Score
AA Index #174 / 368
18.7 Artificial Analysis
Input #409 / 560
$0.800 per 1M tokens
Output #437 / 560
$4.00 per 1M tokens
Context #185 / 560
200,000 tokens

Analysis Summary

Anthropic: Claude 3.5 Haiku sits in the Specialist tier on our leaderboard, ranked #128 of 557 published models on overall intelligence. At $0.800 input and $4.00 output per 1M tokens, it is among the most expensive on the market. It offers a generous context window for extended reasoning and code review and supports tool use, function calling, and vision.

Editorial notes

Claude 3.5 Haiku from Anthropic combines vision, tool use, and a 200K context window with strong instruction following and livecodebench scores, offering a capable mid-tier option for content and light agentic tasks.

Assessed May 14, 2026

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence3.5Technical2.1Value7Content6
Intelligence 3.5/10
Technical 2.1/10
Content 6/10
Value 7/10

Claude 3.5 Haiku features offers enhanced capabilities in speed, coding accuracy, and tool use. Engineered to excel in real-time applications, it delivers quick response times that are essential for dynamic..

Capabilities

Tool Use Function Calling Vision

Performance Indices

Source: Artificial Analysis

18.7 Intelligence Index
10.7 Coding Index
13.4 Agentic Index

Benchmark Scores

Intelligence

GPQA Diamond 40.8% Graduate-level scientific reasoning
HLE 3.5% Humanity's Last Exam
MMLU Pro 63.4% Multi-task language understanding
MATH 500 72.1% Mathematical problem-solving
AIME 3.3% Competition mathematics
SciCode 27.4% Scientific computing

Technical

LiveCodeBench 31.4% Live coding evaluation
TerminalBench Hard 2.3% Agentic terminal tasks
τ²-Bench 24.6% Conversational agent benchmark

Content

IFBench 42.8% Instruction following
LCR 23.3% Long-context reasoning

Benchmark data from Artificial Analysis and Hugging Face

How does Anthropic: Claude 3.5 Haiku stack up?

Compare side-by-side with other specialist models.

Compare Models

Model Information

OpenRouter ID anthropic/claude-3.5-haiku
Provideranthropic
Model FamilyClaude 3.5
Release Date November 4, 2024
Context Length200,000 tokens
Max Completion8,192 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.80 $0.000800
Output $4.00 $0.004000

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

99.9%
Avg Uptime
722ms
Best Latency (TTFT)
35 tok/s
Best Throughput
1/3
Active Endpoints
Available via: Amazon Bedrock, Google

Leaderboard Categories