Meta: Llama 3.1 70B Instruct

Meta: Llama 3.1 70B Instruct

meta-llama · Released Jul 23, 2024 Efficient
Intelligence #222 / 583
39.0 Our Score
Speed #261 / 276
32.3 tokens / sec
Input #358 / 583
$0.400 per 1M tokens
Output #227 / 583
$0.400 per 1M tokens
Context #240 / 583
131,072 tokens

Analysis Summary

Llama 3.1 70B Instruct is Meta's mid-size open-weight model, released in July 2024 with a 131K context window, tool use, and function calling support. Its intelligence index of 6.8 and coding index of 10.9 place it in the lower-mid tier of the current landscape, with reasonable MMLU Pro and GPQA scores for its size.

For businesses, it suits general-purpose text generation, document analysis, coding assistance, and structured output tasks where cost efficiency matters. The large context window makes it practical for long-document workflows. Its agentic index is modest, so complex multi-step agent pipelines are better served by larger models.

At $0.40 per million tokens for both input and output, it offers strong value for a capable open-weight model. Teams needing a self-hostable or cost-effective model for mid-complexity business tasks will find it a practical choice, though newer Llama 3.x releases offer improved performance at comparable prices.

Assessed June 17, 2026

Editorial notes

Llama 3.1 70B Instruct from Meta delivers solid general reasoning and coding capability with tool use, function calling, and a 131K context window at very competitive pricing.

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence1.8Technical1.7Value7.8Content5.5
Intelligence 1.8/10
Technical 1.7/10
Content 5.5/10
Value 7.8/10

How Meta: Llama 3.1 70B Instruct compares

Meta: Llama 3.1 70B Instruct ranks #283 of 380 AI models we track for overall intelligence, #264 of 292 for agentic tasks. Its 131K-token context window is larger than 59% of the models we list. At $0.40 per million input tokens it is cheaper than 39% of comparable models.

About Meta: Llama 3.1 70B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong..

70B Parameters

Capabilities

Tool Use Function Calling

Architecture Detail

Instruct Typellama3

Performance Indices

Source: Artificial Analysis

6.8 Intelligence Index
9.1 Agentic Index
4 Math Index

Benchmark Scores

Intelligence

GPQA Diamond 40.9% Graduate-level scientific reasoning
HLE 4.6% Humanity's Last Exam
MMLU Pro 67.6% Multi-task language understanding
MATH 500 64.9% Mathematical problem-solving
AIME 17.3% Competition mathematics
AIME 2025 4% Competition mathematics (2025)
SciCode 26.7% Scientific computing

Technical

LiveCodeBench 23.2% Live coding evaluation
TerminalBench Hard 3% Agentic terminal tasks
τ²-Bench 15.2% Conversational agent benchmark

Content

IFBench 34.4% Instruction following
LCR 6.3% Long-context reasoning

Benchmark data from Artificial Analysis and Hugging Face

How does Meta: Llama 3.1 70B Instruct stack up?

Compare side-by-side with other efficient models.

Compare Models

Model Information

OpenRouter ID meta-llama/llama-3.1-70b-instruct
Providermeta-llama
Model FamilyLlama 3
Release Date July 23, 2024
Context Length131,072 tokens
Max Completion16,384 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.40 $0.000400
Output $0.40 $0.000400

Live Performance

Live endpoint metrics, refreshed every 30 minutes.

94%
Avg Uptime
244ms
Best Latency (TTFT)
26 tok/s
Best Throughput
3/3
Active Endpoints
Available via: DeepInfra, Amazon Bedrock, WandB

Leaderboard Categories

Frequently asked questions about Meta: Llama 3.1 70B Instruct

How much does Meta: Llama 3.1 70B Instruct cost?

Meta: Llama 3.1 70B Instruct costs $0.40 per million input tokens and $0.40 per million output tokens.

What is the context window of Meta: Llama 3.1 70B Instruct?

Meta: Llama 3.1 70B Instruct has a context window of 131,072 tokens (131K).

What can Meta: Llama 3.1 70B Instruct do?

Meta: Llama 3.1 70B Instruct supports tool use and function calling.

Who created Meta: Llama 3.1 70B Instruct?

Meta: Llama 3.1 70B Instruct is developed by Meta and was released on July 23, 2024.