What are the token costs and operational benchmarks for Gemma 4 31B IT?

Gemma 4 31B IT (Google) is priced at $0.12 per 1M input tokens and $0.36 per 1M output tokens (with prompt cache reads at $0.030/1M tokens). Built on a Dense Open-Weight Transformer architecture with a 131.072k token context window, it delivers 115ms TTFT latency at 155 tokens per sec and scores 59.2% on SWE-bench Verified, 71.2% on GPQA Diamond, 82.8% on MMLU-Pro, and 91.5% on MATH-500 (80.3 IVR).
Verified daily via automated API latency tests and official documentation.
Input / 1M $0.12
Output / 1M $0.36
Cache Read / 1M $0.030
Context Limit 131.072k
TTFT Latency 115ms
Throughput 155 t/s
SWE-bench 59.2%
GPQA Diamond 71.2%

Verified Capability Benchmarks

Composite Intelligence: 74/100
SWE-bench Verified
59.2%
GPQA Diamond
71.2%
MMLU-Pro
82.8%
MATH-500
91.5%
HumanEval Coding
91.8%

Architectural & Production Profile

Google's flagship Gemma 4 31B dense open-weight model delivering frontier-class coding and reasoning on a single enterprise GPU.

Optimal Production Workloads

Self-hosted VPC inference, fine-tuned domain agents, sovereign healthcare/finance workloads, and low-latency local code generation.

Architecture
Dense Open-Weight Transformer
Modalities
Text, Vision, Code
Max Output Tokens
16,384 tokens
Blended Rate (3:1)
$0.180 / 1M

Verified Cloud Inference Endpoints Hosting Gemma 4 31B IT

Compare latency, streaming speed, and token pricing across cloud API providers.

All Cloud Providers →
Inference Provider Role Input / 1M Output / 1M Avg TTFT Throughput
Google Gemini & Vertex AI → Primary Host $0.12 $0.36 115ms 155 tok/s
Groq LPU Inference → Partner Endpoint $0.12 $0.36 75ms 279 tok/s

Interactive Monthly Token Economics & ROI Forecaster

Model production workloads across prompt, completion, and cached context tokens, or switch models on the fly.

25.0M Tokens
500K 50M 250M 500M+
5.0M Tokens
100K 25M 75M 150M+
50% Cached
0% (Uncached) 25% 50% (Typical Agent) 95% Max

Estimated Monthly Spend

Gemma 4 31B IT $3.68

$0.12/1M in · $0.36/1M out

Prompt Cache: $0.030/1M read · $0.12/1M write

Gemini 4 Argon $76.25

$2.00/1M in · $10.00/1M out

Prompt Cache: $0.100/1M read · $0.50/1M write

Projected Monthly Cost Reduction
$72.58 / mo
(95.2% lower cost with Gemma 4 31B IT)
Open Full Matchup Analysis →

Head-to-Head Comparisons Involving Gemma 4 31B IT (36)

Versus Comparison →

Gemma 4 31B IT vs Gemini 4 Argon

Gemma 4 31B IT is 94.0% cheaper for input tokens ($0.12 vs. $2.00 per 1M tokens) and $0.36 vs. $10.00 for output tokens (16.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (735ms faster than Gemini 4 Argon) with 155 vs. 115 tok/s throughput. Gemini 4 Argon leads coding evaluations at 84.5% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 93.8% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Claude 4.5 Sonnet

Gemma 4 31B IT is 96.0% cheaper for input tokens ($0.12 vs. $3.00 per 1M tokens) and $0.36 vs. $15.00 for output tokens (25.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (265ms faster than Claude 4.5 Sonnet) with 155 vs. 84 tok/s throughput. Claude 4.5 Sonnet leads coding evaluations at 75.8% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 84.2% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Claude Opus 5.5

Gemma 4 31B IT is 97.0% cheaper for input tokens ($0.12 vs. $4.00 per 1M tokens) and $0.36 vs. $20.00 for output tokens (33.3x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (565ms faster than Claude Opus 5.5) with 155 vs. 95 tok/s throughput. Claude Opus 5.5 leads coding evaluations at 89.9% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 93.2% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Gemini 3.8 Flash

Gemma 4 31B IT is 52.0% cheaper for input tokens ($0.12 vs. $0.25 per 1M tokens) and $0.36 vs. $1.50 for output tokens (2.1x cost advantage). In terms of operational performance, Gemini 3.8 Flash delivers lower response latency at 105ms TTFT (10ms faster than Gemma 4 31B IT) with 210 vs. 155 tok/s throughput. Gemini 3.8 Flash leads coding evaluations at 68.5% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 79.2% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GPT-5

Gemma 4 31B IT is 95.2% cheaper for input tokens ($0.12 vs. $2.50 per 1M tokens) and $0.36 vs. $10.00 for output tokens (20.8x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (225ms faster than GPT-5) with 155 vs. 105 tok/s throughput. GPT-5 leads coding evaluations at 74.9% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 85.4% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GPT-6 Astra

Gemma 4 31B IT is 98.8% cheaper for input tokens ($0.12 vs. $10.00 per 1M tokens) and $0.36 vs. $50.00 for output tokens (83.3x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (625ms faster than GPT-6 Astra) with 155 vs. 74 tok/s throughput. GPT-6 Astra leads coding evaluations at 75.7% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 96.0% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs DeepSeek V4 Pro

Gemma 4 31B IT is 90.9% cheaper for input tokens ($0.12 vs. $1.32 per 1M tokens) and $0.36 vs. $3.96 for output tokens (11.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (405ms faster than DeepSeek V4 Pro) with 155 vs. 78 tok/s throughput. DeepSeek V4 Pro leads coding evaluations at 80.6% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 90.1% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs DeepSeek R1

Gemma 4 31B IT is 78.2% cheaper for input tokens ($0.12 vs. $0.55 per 1M tokens) and $0.36 vs. $2.19 for output tokens (4.6x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (1335ms faster than DeepSeek R1) with 155 vs. 58 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 49.2% for DeepSeek R1 and 71.2% vs. 71.5% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs DeepSeek V4 Flash Vision (Exp)

Gemma 4 31B IT is 45.5% cheaper for input tokens ($0.12 vs. $0.22 per 1M tokens) and $0.36 vs. $0.65 for output tokens (1.8x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (195ms faster than DeepSeek V4 Flash Vision (Exp)) with 155 vs. 165 tok/s throughput. DeepSeek V4 Flash Vision (Exp) leads coding evaluations at 77.4% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 91.3% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs OpenAI o3

Gemma 4 31B IT is 94.0% cheaper for input tokens ($0.12 vs. $2.00 per 1M tokens) and $0.36 vs. $8.00 for output tokens (16.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (1035ms faster than OpenAI o3) with 155 vs. 82 tok/s throughput. OpenAI o3 leads coding evaluations at 71.7% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 87.7% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Claude 4 Opus

Gemma 4 31B IT is 99.2% cheaper for input tokens ($0.12 vs. $15.00 per 1M tokens) and $0.36 vs. $75.00 for output tokens (125.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (805ms faster than Claude 4 Opus) with 155 vs. 46 tok/s throughput. Claude 4 Opus leads coding evaluations at 77.2% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 87.1% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Claude 3.7 Sonnet

Gemma 4 31B IT is 96.0% cheaper for input tokens ($0.12 vs. $3.00 per 1M tokens) and $0.36 vs. $15.00 for output tokens (25.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (425ms faster than Claude 3.7 Sonnet) with 155 vs. 72 tok/s throughput. Claude 3.7 Sonnet leads coding evaluations at 70.3% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 78.5% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Gemini 3.1 Pro

Gemma 4 31B IT is 90.4% cheaper for input tokens ($0.12 vs. $1.25 per 1M tokens) and $0.36 vs. $10.00 for output tokens (10.4x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (305ms faster than Gemini 3.1 Pro) with 155 vs. 98 tok/s throughput. Gemini 3.1 Pro leads coding evaluations at 71.8% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 82.4% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Grok 4

Gemma 4 31B IT is 95.2% cheaper for input tokens ($0.12 vs. $2.50 per 1M tokens) and $0.36 vs. $12.50 for output tokens (20.8x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (365ms faster than Grok 4) with 155 vs. 95 tok/s throughput. Grok 4 leads coding evaluations at 73.2% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 86.2% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Llama 4 Maverick

Gemma 4 31B IT is 40.0% cheaper for input tokens ($0.12 vs. $0.20 per 1M tokens) and $0.36 vs. $0.60 for output tokens (1.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (20ms faster than Llama 4 Maverick) with 155 vs. 175 tok/s throughput. Llama 4 Maverick leads coding evaluations at 62.4% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 73.8% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Qwen 3.8 Flash Next

Gemma 4 31B IT is 25.0% cheaper for input tokens ($0.12 vs. $0.16 per 1M tokens) and $0.36 vs. $0.47 for output tokens (1.3x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (165ms faster than Qwen 3.8 Flash Next) with 155 vs. 185 tok/s throughput. Qwen 3.8 Flash Next leads coding evaluations at 81.0% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 91.7% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Gemini 3.5 Flash-Lite

Gemini 3.5 Flash-Lite is 37.5% cheaper for input tokens ($0.07 vs. $0.12 per 1M tokens) and $0.30 vs. $0.36 for output tokens (1.6x cost advantage). In terms of operational performance, Gemini 3.5 Flash-Lite delivers lower response latency at 78ms TTFT (37ms faster than Gemma 4 31B IT) with 265 vs. 155 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 55.4% for Gemini 3.5 Flash-Lite and 71.2% vs. 68.4% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs OpenAI o4-mini

Gemma 4 31B IT is 89.1% cheaper for input tokens ($0.12 vs. $1.10 per 1M tokens) and $0.36 vs. $4.40 for output tokens (9.2x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (565ms faster than OpenAI o4-mini) with 155 vs. 125 tok/s throughput. OpenAI o4-mini leads coding evaluations at 68.1% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 81.4% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs DeepSeek V3

Gemma 4 31B IT is 14.3% cheaper for input tokens ($0.12 vs. $0.14 per 1M tokens) and $0.36 vs. $0.28 for output tokens (1.2x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (295ms faster than DeepSeek V3) with 155 vs. 78 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 42.0% for DeepSeek V3 and 71.2% vs. 59.1% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs OpenAI o3-mini

Gemma 4 31B IT is 89.1% cheaper for input tokens ($0.12 vs. $1.10 per 1M tokens) and $0.36 vs. $4.40 for output tokens (9.2x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (835ms faster than OpenAI o3-mini) with 155 vs. 98 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 49.3% for OpenAI o3-mini and 71.2% vs. 79.7% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Claude 3.5 Haiku

Gemma 4 31B IT is 85.0% cheaper for input tokens ($0.12 vs. $0.80 per 1M tokens) and $0.36 vs. $4.00 for output tokens (6.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (75ms faster than Claude 3.5 Haiku) with 155 vs. 130 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 40.6% for Claude 3.5 Haiku and 71.2% vs. 41.6% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Claude 3.5 Sonnet

Gemma 4 31B IT is 96.0% cheaper for input tokens ($0.12 vs. $3.00 per 1M tokens) and $0.36 vs. $15.00 for output tokens (25.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (195ms faster than Claude 3.5 Sonnet) with 155 vs. 80 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 49.0% for Claude 3.5 Sonnet and 71.2% vs. 59.4% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Gemini 2.0 Flash

Gemini 2.0 Flash is 16.7% cheaper for input tokens ($0.10 vs. $0.12 per 1M tokens) and $0.40 vs. $0.36 for output tokens (1.2x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (165ms faster than Gemini 2.0 Flash) with 155 vs. 185 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 51.8% for Gemini 2.0 Flash and 71.2% vs. 63.6% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Gemini 2.5 Flash

Gemma 4 31B IT is 60.0% cheaper for input tokens ($0.12 vs. $0.30 per 1M tokens) and $0.36 vs. $2.50 for output tokens (2.5x cost advantage). In terms of operational performance, Gemini 2.5 Flash delivers lower response latency at 110ms TTFT (5ms faster than Gemma 4 31B IT) with 180 vs. 155 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 58.0% for Gemini 2.5 Flash and 71.2% vs. 70.5% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Gemini 2.5 Pro

Gemma 4 31B IT is 90.4% cheaper for input tokens ($0.12 vs. $1.25 per 1M tokens) and $0.36 vs. $10.00 for output tokens (10.4x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (585ms faster than Gemini 2.5 Pro) with 155 vs. 80 tok/s throughput. Gemini 2.5 Pro leads coding evaluations at 63.8% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 74.0% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GLM-5.3

Gemma 4 31B IT is 65.7% cheaper for input tokens ($0.12 vs. $0.35 per 1M tokens) and $0.36 vs. $1.00 for output tokens (2.9x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (45ms faster than GLM-5.3) with 155 vs. 120 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 56.0% for GLM-5.3 and 71.2% vs. 67.0% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GLM-5.3-Flash

Gemma 4 31B IT and GLM-5.3-Flash share identical input pricing at $0.12 per 1M tokens ($0.36 vs. $0.40 output). In terms of operational performance, GLM-5.3-Flash delivers lower response latency at 90ms TTFT (25ms faster than Gemma 4 31B IT) with 175 vs. 155 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 52.8% for GLM-5.3-Flash and 71.2% vs. 63.5% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GPT-4o

Gemma 4 31B IT is 95.2% cheaper for input tokens ($0.12 vs. $2.50 per 1M tokens) and $0.36 vs. $10.00 for output tokens (20.8x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (165ms faster than GPT-4o) with 155 vs. 100 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 48.0% for GPT-4o and 71.2% vs. 53.6% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GPT-4o Mini

Gemma 4 31B IT is 20.0% cheaper for input tokens ($0.12 vs. $0.15 per 1M tokens) and $0.36 vs. $0.60 for output tokens (1.2x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (105ms faster than GPT-4o Mini) with 155 vs. 140 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 41.0% for GPT-4o Mini and 71.2% vs. 40.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs GPT-6.1 Sol

Gemma 4 31B IT is 94.0% cheaper for input tokens ($0.12 vs. $2.00 per 1M tokens) and $0.36 vs. $10.00 for output tokens (16.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (405ms faster than GPT-6.1 Sol) with 155 vs. 135 tok/s throughput. GPT-6.1 Sol leads coding evaluations at 86.4% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 92.4% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Grok 3

Gemma 4 31B IT is 96.0% cheaper for input tokens ($0.12 vs. $3.00 per 1M tokens) and $0.36 vs. $15.00 for output tokens (25.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (505ms faster than Grok 3) with 155 vs. 88 tok/s throughput. Grok 3 leads coding evaluations at 65.8% SWE-bench Verified vs. 59.2% for Gemma 4 31B IT and 84.6% vs. 71.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Grok 3 Mini

Gemma 4 31B IT is 60.0% cheaper for input tokens ($0.12 vs. $0.30 per 1M tokens) and $0.36 vs. $1.20 for output tokens (2.5x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (35ms faster than Grok 3 Mini) with 155 vs. 160 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 54.0% for Grok 3 Mini and 71.2% vs. 68.0% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Llama 3.3 70B Instruct

Gemma 4 31B IT and Llama 3.3 70B Instruct share identical input pricing at $0.12 per 1M tokens ($0.36 vs. $0.30 output). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (30ms faster than Llama 3.3 70B Instruct) with 155 vs. 165 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 42.5% for Llama 3.3 70B Instruct and 71.2% vs. 55.6% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Mistral Large 2 (2411)

Gemma 4 31B IT is 94.0% cheaper for input tokens ($0.12 vs. $2.00 per 1M tokens) and $0.36 vs. $6.00 for output tokens (16.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (265ms faster than Mistral Large 2 (2411)) with 155 vs. 75 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 45.2% for Mistral Large 2 (2411) and 71.2% vs. 54.2% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs o1

Gemma 4 31B IT is 99.2% cheaper for input tokens ($0.12 vs. $15.00 per 1M tokens) and $0.36 vs. $60.00 for output tokens (125.0x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (2485ms faster than o1) with 155 vs. 48 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 48.9% for o1 and 71.2% vs. 78.0% on GPQA Diamond.

Versus Comparison →

Gemma 4 31B IT vs Qwen 3.8 27B

Gemma 4 31B IT is 40.0% cheaper for input tokens ($0.12 vs. $0.20 per 1M tokens) and $0.36 vs. $0.60 for output tokens (1.7x cost advantage). In terms of operational performance, Gemma 4 31B IT delivers lower response latency at 115ms TTFT (5ms faster than Qwen 3.8 27B) with 155 vs. 140 tok/s throughput. Gemma 4 31B IT leads coding evaluations at 59.2% SWE-bench Verified vs. 58.4% for Qwen 3.8 27B and 71.2% vs. 68.0% on GPQA Diamond.

Frequently Asked Questions & Query Fan-Out

How much does Gemma 4 31B IT cost per 1M tokens including prompt caching?

Gemma 4 31B IT costs $0.12 per million input tokens and $0.36 per million output tokens. Cached input reads cost $0.030 per 1M tokens, reducing repeated context costs by 75%.

What are Gemma 4 31B IT's coding and reasoning benchmark scores?

Gemma 4 31B IT achieves 59.2% on SWE-bench Verified, 91.8% on HumanEval coding, 71.2% on GPQA Diamond graduate-level science, 82.8% on MMLU-Pro, and 91.5% on MATH-500, earning an overall Inference Value Ratio (IVR) of 80.3/100.

What is the context window, TTFT latency, and token throughput of Gemma 4 31B IT?

Gemma 4 31B IT supports a 131,072 token context window (16,384 max output tokens) and operates at 115ms average Time to First Token (TTFT) with 155 tokens/sec output streaming throughput.

What are the primary production use cases for Gemma 4 31B IT?

Self-hosted VPC inference, fine-tuned domain agents, sovereign healthcare/finance workloads, and low-latency local code generation.