Mistral: Mistral Small 3.1 24B (free)

Mistral: Mistral Small 3.1 24B (free)

mistralai · Released Mar 17, 2025
42
Our Score

Mistral Small 3.1 24B Instruct is an upgraded variant of Mistral Small 3 (2501), featuring 24 billion parameters with advanced multimodal capabilities. It provides state-of-the-art performance in text-based reasoning and vision tasks, including image analysis, programming, mathematical reasoning, and multilingual support across dozens of languages. Equipped with an extensive 128k token context window and optimized for efficient local inference, it supports use cases such as conversational agents, function calling, long-document comprehension, and privacy-sensitive deployments. The updated version is Mistral Small 3.2

128,000 tokens Context Window
24B Parameters

Capabilities

Tool Use Function Calling Vision

Architecture

ModalityText + Image → Text
TokenizerMistral
Parameters24B

Performance Indices

Source: Artificial Analysis

14.5 Intelligence Index
13.9 Coding Index
16.4 Agentic Index
3.7 Math Index

Benchmark Scores

Evaluations

GPQA Diamond 45.4%
Graduate-level scientific reasoning
HLE 4.8%
Humanity's Last Exam
MMLU Pro 65.9%
Multi-task language understanding
LiveCodeBench 21.2%
Live coding evaluation
SciCode 26.5%
Scientific computing
MATH 500 70.7%
Mathematical problem-solving
AIME 9.3%
Competition mathematics
AIME 2025 3.7%
Competition mathematics (2025)
IFBench 29.9%
Instruction following
LCR 19.7%
Long-context reasoning
TerminalBench Hard 7.6%
Agentic terminal tasks
τ²-Bench 25.1%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID mistralai/mistral-small-3.1-24b-instruct:free
Providermistralai
Model FamilyMistral
Release Date March 17, 2025
Context Length128,000 tokens
Status Active

Leaderboard Categories