0xSero
0xSero/Gemma 4 21B A4B IT REAP

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
4bitMLX's logo.
Gabe Garcia
Gabe Garcia		11.9 GB68.6 tok/s754.3 tok/sRuns well

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

2 devices
Gemma 4 21B A4B IT REAP by 0xSero | whatcani.run