Google: Gemma 3 4B (free)

Google: Gemma 3 4B (free)

google · Released Mar 13, 2025
25
Our Score

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling.

32,768 tokens Context Window
8,192 tokens Max Output
4B Parameters

Capabilities

Function Calling Vision

Architecture

ModalityText + Image → Text
TokenizerGemini
Instruct Typegemma
Parameters4B

Performance Indices

Source: Artificial Analysis

6.3 Intelligence Index
2.9 Coding Index
2.9 Agentic Index
12.7 Math Index

Benchmark Scores

Evaluations

GPQA Diamond 29.1%
Graduate-level scientific reasoning
HLE 5.2%
Humanity's Last Exam
MMLU Pro 41.7%
Multi-task language understanding
LiveCodeBench 11.2%
Live coding evaluation
SciCode 7.3%
Scientific computing
MATH 500 76.6%
Mathematical problem-solving
AIME 6.3%
Competition mathematics
AIME 2025 12.7%
Competition mathematics (2025)
IFBench 28.3%
Instruction following
LCR 5.7%
Long-context reasoning
TerminalBench Hard 0.8%
Agentic terminal tasks
τ²-Bench 5%
Conversational agent benchmark

Benchmark data from Artificial Analysis and Hugging Face

Model Information

OpenRouter ID google/gemma-3-4b-it:free
Providergoogle
Release Date March 13, 2025
Context Length32,768 tokens
Max Completion8,192 tokens
Status Active

Live Performance

Live endpoint metrics — refreshed every 30 minutes.

100%
Avg Uptime
1/1
Active Endpoints
Available via: Google AI Studio