Meta: Llama 3 70B Instruct

Meta: Llama 3 70B Instruct

meta-llama · Released Apr 18, 2024 Efficient
30.7
Our Score

Performance Profile

Intelligence2.2Technical0.8Value6.8Content3
Intelligence 2.2/10
Technical 0.8/10
Content 3/10
Value 6.8/10

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. Usage of this model is subject to Meta's Acceptable Use Policy.

$0.51 / 1M
Input Price
$0.74 / 1M
Output Price
8,192 tokens
Context Window
8,000 tokens
Max Output
70B Parameters

Architecture

ModalityText → Text
TokenizerLlama3
Instruct Typellama3
Parameters70B

Performance Indices

Source: Artificial Analysis

8.9 Intelligence Index
6.8 Coding Index
0.8 Agentic Index

Benchmark Scores

Intelligence

GPQA Diamond 37.9% Graduate-level scientific reasoning
HLE 4.4% Humanity's Last Exam
MMLU Pro 57.4% Multi-task language understanding
MATH 500 48.3% Mathematical problem-solving
SciCode 18.9% Scientific computing

Technical

LiveCodeBench 19.8% Live coding evaluation
TerminalBench Hard 0.8% Agentic terminal tasks

Content

IFBench 37.1% Instruction following

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID meta-llama/llama-3-70b-instruct
Providermeta-llama
Model FamilyLlama 3
Release Date April 18, 2024
Context Length8,192 tokens
Max Completion8,000 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.51 $0.000510
Output $0.74 $0.000740

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

98.5%
Avg Uptime
55,958ms
Best Latency (TTFT)
1/1
Active Endpoints
Available via: Novita