Google: Gemma 3n 4B (free)

Google: Gemma 3n 4B (free)

google · Released May 20, 2025
22
Our Score

Gemma 3n E4B-it is optimized for efficient execution on mobile and low-resource devices, such as phones, laptops, and tablets. It supports multimodal inputs—including text, visual data, and audio—enabling diverse tasks such as text generation, speech recognition, translation, and image analysis. Leveraging innovations like Per-Layer Embedding (PLE) caching and the MatFormer architecture, Gemma 3n dynamically manages memory usage and computational load by selectively activating model parameters, significantly reducing runtime resource requirements. This model supports a wide linguistic range (trained in over 140 languages) and features a flexible 32K token context window. Gemma 3n can selectively load parameters, optimizing memory and computational efficiency based on the task or device capabilities, making it well-suited for privacy-focused, offline-capable applications and on-device AI solutions. Read more in the blog post

8,192 tokens Context Window
2,048 tokens Max Output
4B Parameters

Architecture

ModalityText → Text
TokenizerOther
Parameters4B

Performance Indices

Source: Artificial Analysis

6.4 Intelligence Index
4.2 Coding Index
3.7 Agentic Index
14.3 Math Index

Benchmark Scores

Evaluations

GPQA Diamond 29.6%
Graduate-level scientific reasoning
HLE 4.4%
Humanity's Last Exam
MMLU Pro 48.8%
Multi-task language understanding
LiveCodeBench 14.6%
Live coding evaluation
SciCode 8.1%
Scientific computing
MATH 500 77.1%
Mathematical problem-solving
AIME 13.7%
Competition mathematics
AIME 2025 14.3%
Competition mathematics (2025)
IFBench 27.9%
Instruction following
TerminalBench Hard 2.3%
Agentic terminal tasks
τ²-Bench 5%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID google/gemma-3n-e4b-it:free
Providergoogle
Release Date May 20, 2025
Context Length8,192 tokens
Max Completion2,048 tokens
Status Active

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
388ms
Best Latency (TTFT)
57 tok/s
Best Throughput
1/1
Active Endpoints
Available via: Google AI Studio