Nous: Hermes 3 70B Instruct

Nous: Hermes 3 70B Instruct

nousresearch · Released Aug 18, 2024
35
Our Score

Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the board. Hermes 3 70B is a competitive, if not superior finetune of the Llama-3.1 70B foundation model, focused on aligning LLMs to the user, with powerful steering capabilities and control given to the end user. The Hermes 3 series builds and expands on the Hermes 2 set of capabilities, including more powerful and reliable function calling and structured output capabilities, generalist assistant capabilities, and improved code generation skills.

$0.30 / 1M Input Price
$0.30 / 1M Output Price
131,072 tokens Context Window
70B Parameters

Capabilities

Function Calling

Architecture

ModalityText → Text
TokenizerLlama3
Instruct Typechatml
Parameters70B

Performance Indices

Source: Artificial Analysis

10.6 Intelligence Index

Benchmark Scores

Evaluations

GPQA Diamond 40.1%
Graduate-level scientific reasoning
HLE 4.1%
Humanity's Last Exam
MMLU Pro 57.1%
Multi-task language understanding
LiveCodeBench 18.8%
Live coding evaluation
SciCode 23.1%
Scientific computing
MATH 500 53.8%
Mathematical problem-solving
AIME 2.3%
Competition mathematics

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID nousresearch/hermes-3-llama-3.1-70b
Providernousresearch
Release Date August 18, 2024
Context Length131,072 tokens
Status Active

Pricing

Token Type Cost per 1M tokens Cost per 1K tokens
Input $0.30 $0.000300
Output $0.30 $0.000300

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
553ms
Best Latency (TTFT)
40 tok/s
Best Throughput
1/1
Active Endpoints
Available via: DeepInfra

Leaderboard Categories