Google: Gemma 3 12B (free)

Google: Gemma 3 12B (free)

google · Released Mar 13, 2025
30
Our Score

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 12B is the second largest in the family of Gemma 3 models after Gemma 3 27B

32,768 tokens Context Window
8,192 tokens Max Output
12B Parameters

Capabilities

Function Calling Vision

Architecture

ModalityText + Image → Text
TokenizerGemini
Instruct Typegemma
Parameters12B

Performance Indices

Source: Artificial Analysis

8.8 Intelligence Index
6.3 Coding Index
5.8 Agentic Index
18.3 Math Index

Benchmark Scores

Evaluations

GPQA Diamond 34.9%
Graduate-level scientific reasoning
HLE 4.8%
Humanity's Last Exam
MMLU Pro 59.5%
Multi-task language understanding
LiveCodeBench 13.7%
Live coding evaluation
SciCode 17.4%
Scientific computing
MATH 500 85.3%
Mathematical problem-solving
AIME 22%
Competition mathematics
AIME 2025 18.3%
Competition mathematics (2025)
IFBench 36.7%
Instruction following
LCR 6.7%
Long-context reasoning
TerminalBench Hard 0.8%
Agentic terminal tasks
τ²-Bench 10.8%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID google/gemma-3-12b-it:free
Providergoogle
Release Date March 13, 2025
Context Length32,768 tokens
Max Completion8,192 tokens
Status Active