Anthropic: Claude 3.5 Sonnet

Anthropic: Claude 3.5 Sonnet

anthropic · Released Oct 22, 2024
55
Our Score

New Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at: - Coding: Scores ~49% on SWE-Bench Verified, higher than the last best score, and without any fancy prompt scaffolding
- Data science: Augments human data science expertise; navigates unstructured data while using multiple tools for insights
- Visual processing: excelling at interpreting charts, graphs, and images, accurately transcribing text to derive insights beyond just the text alone
- Agentic tasks: exceptional tool use, making it great at agentic tasks (i.e. complex, multi-step problem solving tasks that require engaging with other systems) #multimodal

$6.00 / 1M Input Price
$30.00 / 1M Output Price
200,000 tokens Context Window
8,192 tokens Max Output

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image + File → Text
TokenizerClaude

Performance Indices

Source: Artificial Analysis

15.9 Intelligence Index
30.2 Coding Index

Benchmark Scores

Evaluations

GPQA Diamond 59.9%
Graduate-level scientific reasoning
HLE 3.9%
Humanity's Last Exam
MMLU Pro 77.2%
Multi-task language understanding
LiveCodeBench 38.1%
Live coding evaluation
SciCode 36.6%
Scientific computing
MATH 500 77.1%
Mathematical problem-solving
AIME 15.7%
Competition mathematics

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID anthropic/claude-3.5-sonnet
Provideranthropic
Model FamilyClaude 3.5
Release Date October 22, 2024
Context Length200,000 tokens
Max Completion8,192 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $6.00 $0.006000
Output $30.00 $0.030000

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

99%
Avg Uptime
916ms
Best Latency (TTFT)
34 tok/s
Best Throughput
2/2
Active Endpoints
Available via: Amazon Bedrock

Leaderboard Categories