Meta: Llama 3 70B Instruct

Meta: Llama 3 70B Instruct

meta-llama · Released Apr 18, 2024
38
Our Score

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. Usage of this model is subject to Meta's Acceptable Use Policy.

$0.51 / 1M Input Price
$0.74 / 1M Output Price
8,192 tokens Context Window
8,000 tokens Max Output
70B Parameters

Architecture

ModalityText → Text
TokenizerLlama3
Instruct Typellama3
Parameters70B

Performance Indices

Source: Artificial Analysis

8.9 Intelligence Index
6.8 Coding Index
0.8 Agentic Index

Benchmark Scores

Evaluations

GPQA Diamond 37.9%
Graduate-level scientific reasoning
HLE 4.4%
Humanity's Last Exam
MMLU Pro 57.4%
Multi-task language understanding
LiveCodeBench 19.8%
Live coding evaluation
SciCode 18.9%
Scientific computing
MATH 500 48.3%
Mathematical problem-solving
IFBench 37.1%
Instruction following
TerminalBench Hard 0.8%
Agentic terminal tasks

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID meta-llama/llama-3-70b-instruct
Providermeta-llama
Model FamilyLlama 3
Release Date April 18, 2024
Context Length8,192 tokens
Max Completion8,000 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.51 $0.000510
Output $0.74 $0.000740

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
767ms
Best Latency (TTFT)
3 tok/s
Best Throughput
1/1
Active Endpoints
Available via: Novita