Google: Gemma 3 4B (free)

Google: Gemma 3 4B (free)

google · Released Mar 13, 2025 Emerging
Intelligence #479 / 544
12.2 Our Score
Speed #234 / 251
33.2 tokens / sec
Input
Not priced
Output
Not priced
Context #355 / 544
32,768 tokens

Analysis Summary

Google: Gemma 3 4B (free) sits in the Emerging tier on our leaderboard, ranked #479 of 544 published models on overall intelligence. At $0.000 input and $0.000 output per 1M tokens, it is among the most expensive on the market. It offers a mid-sized context window and supports vision.

Editorial notes

Google's Gemma 3 4B is a very small, free model with vision capability but limited reasoning and coding scores, best suited for lightweight experimentation rather than business-critical tasks.

Assessed April 23, 2026

Rankings consider pricing, capabilities, benchmarks, and real-world applicability and are refreshed as new models launch. Feedback?

Performance Profile

Intelligence1.6Technical0.5Value0Content2.5
Intelligence 1.6/10
Technical 0.5/10
Content 2.5/10
Value 0/10

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities,..

4B Parameters

Capabilities

Vision

Architecture Detail

Instruct Typegemma

Performance Indices

Source: Artificial Analysis

6.3 Intelligence Index
2.9 Coding Index
2.9 Agentic Index
12.7 Math Index

Benchmark Scores

Intelligence

GPQA Diamond 29.1% Graduate-level scientific reasoning
HLE 5.2% Humanity's Last Exam
MMLU Pro 41.7% Multi-task language understanding
MATH 500 76.6% Mathematical problem-solving
AIME 6.3% Competition mathematics
AIME 2025 12.7% Competition mathematics (2025)
SciCode 7.3% Scientific computing

Technical

LiveCodeBench 11.2% Live coding evaluation
TerminalBench Hard 0.8% Agentic terminal tasks
τ²-Bench 5% Conversational agent benchmark

Content

IFBench 28.3% Instruction following
LCR 5.7% Long-context reasoning

Benchmark data from Artificial Analysis and Hugging Face

How does Google: Gemma 3 4B (free) stack up?

Compare side-by-side with other emerging models.

Compare Models

Model Information

OpenRouter ID google/gemma-3-4b-it:free
Providergoogle
Release Date March 13, 2025
Context Length32,768 tokens
Max Completion8,192 tokens
Status Active

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

99.8%
Avg Uptime
1/1
Active Endpoints
Available via: Google AI Studio