Google: Gemma 3n 4B (free)

Google: Gemma 3n 4B (free)

google · Released May 20, 2025 Emerging
12.3
Our Score

Performance Profile

Intelligence1.7Technical0.7Value0Content2
Intelligence 1.7/10
Technical 0.7/10
Content 2/10
Value 0/10

Gemma 3n E4B-it is optimized for efficient execution on mobile and low-resource devices, such as phones, laptops, and tablets. It supports multimodal inputs—including text, visual data, and audio—enabling diverse tasks such as text generation, speech recognition, translation, and image analysis. Leveraging innovations like Per-Layer Embedding (PLE) caching and the MatFormer architecture, Gemma 3n dynamically manages memory usage and computational load by selectively activating model parameters, significantly reducing runtime resource requirements. This model supports a wide linguistic range (trained in over 140 languages) and features a flexible 32K token context window. Gemma 3n can selectively load parameters, optimizing memory and computational efficiency based on the task or device capabilities, making it well-suited for privacy-focused, offline-capable applications and on-device AI solutions. Read more in the blog post

8,192 tokens
Context Window
2,048 tokens
Max Output
4B Parameters

Architecture

ModalityText → Text
TokenizerOther
Parameters4B

Performance Indices

Source: Artificial Analysis

6.4 Intelligence Index
4.2 Coding Index
3.7 Agentic Index
14.3 Math Index

Benchmark Scores

Intelligence

GPQA Diamond 29.6% Graduate-level scientific reasoning
HLE 4.4% Humanity's Last Exam
MMLU Pro 48.8% Multi-task language understanding
MATH 500 77.1% Mathematical problem-solving
AIME 13.7% Competition mathematics
AIME 2025 14.3% Competition mathematics (2025)
SciCode 8.1% Scientific computing

Technical

LiveCodeBench 14.6% Live coding evaluation
TerminalBench Hard 2.3% Agentic terminal tasks
τ²-Bench 5% Conversational agent benchmark

Content

IFBench 27.9% Instruction following

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID google/gemma-3n-e4b-it:free
Providergoogle
Release Date May 20, 2025
Context Length8,192 tokens
Max Completion2,048 tokens
Status Active

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
618ms
Best Latency (TTFT)
48 tok/s
Best Throughput
1/1
Active Endpoints
Available via: Google AI Studio