Google

Google

Google/Gemma 4 E2B IT

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score	Actions
q4_k_m	Unsloth Unsloth	2.9 GB	36.2 tok/s	613.8 tok/s	Runs ok	Run
q4_k_m	Unsloth Unsloth	2.9 GB	29.6 tok/s	354.2 tok/s	Runs ok	Run
q4_k_m	Unsloth Unsloth	2.9 GB	N/A	N/A	N/A	Run
4bit	MLX Community MLX Community	3.3 GB	N/A	N/A	N/A	Run

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.