Google

Google

Google/Gemma 4 E2B IT

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score	Actions
iq4_nl	Unsloth Unsloth	2.8 GB	N/A	N/A	N/A	Run
q4_k_m	Unsloth Unsloth	2.9 GB	33.1 tok/s	420.8 tok/s	Runs ok	Run
4bit	MLX Community MLX Community	3.3 GB	N/A	N/A	N/A	Run
OptiQ-4bit	MLX Community MLX Community	3.9 GB	68.1 tok/s	1,759.4 tok/s	Runs great	Run
mxfp4	MLX Community MLX Community	4.0 GB	65.5 tok/s	1,876.4 tok/s	Runs great	Run
ud_q4_k_xl	Unsloth Unsloth	4.8 GB	N/A	N/A	N/A	Run
8bit	MLX Community MLX Community	5.5 GB	68.1 tok/s	2,159.2 tok/s	Runs great	Run

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.