Google: Gemma 3 12B (free)

Google: Gemma 3 12B (free)

google · Released Mar 13, 2025 Emerging
Intelligence #476 / 551
16.0 Our Score
Speed #246 / 257
31.7 tokens / sec
Input
Not priced
Output
Not priced
Context #362 / 552
32,768 tokens

Analysis Summary

Google: Gemma 3 12B (free) sits in the Emerging tier on our leaderboard, ranked #476 of 551 published models on overall intelligence. At $0.000 input and $0.000 output per 1M tokens, it is among the most expensive on the market. It offers a mid-sized context window and supports vision.

Editorial notes

Gemma 3 12B (free) from Google is a zero-cost vision model with modest benchmark scores; useful for experimentation and lightweight tasks where cost is the primary constraint.

Assessed May 5, 2026

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence2.2Technical0.9Value0Content3
Intelligence 2.2/10
Technical 0.9/10
Content 3/10
Value 0/10

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities,..

12B Parameters

Capabilities

Vision

Architecture Detail

Instruct Typegemma

Performance Indices

Source: Artificial Analysis

8.8 Intelligence Index
6.3 Coding Index
5.8 Agentic Index
18.3 Math Index

Benchmark Scores

Intelligence

GPQA Diamond 34.9% Graduate-level scientific reasoning
HLE 4.8% Humanity's Last Exam
MMLU Pro 59.5% Multi-task language understanding
MATH 500 85.3% Mathematical problem-solving
AIME 22% Competition mathematics
AIME 2025 18.3% Competition mathematics (2025)
SciCode 17.4% Scientific computing

Technical

LiveCodeBench 13.7% Live coding evaluation
TerminalBench Hard 0.8% Agentic terminal tasks
τ²-Bench 10.8% Conversational agent benchmark

Content

IFBench 36.7% Instruction following
LCR 6.7% Long-context reasoning

Benchmark data from Artificial Analysis and Hugging Face

How does Google: Gemma 3 12B (free) stack up?

Compare side-by-side with other emerging models.

Compare Models

Model Information

OpenRouter ID google/gemma-3-12b-it:free
Providergoogle
Release Date March 13, 2025
Context Length32,768 tokens
Max Completion8,192 tokens
Status Active