Qwen

Qwen

Qwen/Qwen3.5-2B

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score	Actions
q6_k	Unsloth Unsloth	1.5 GB	N/A	N/A	N/A	Run
6bit	MLX Community MLX Community	2.0 GB	96.7 tok/s	1,095.4 tok/s	Runs great	Run

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.