Jackrong
Jackrong
/Qwen3.5-9B (GLM-5.1 Distill) v1

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
Jackrong
Jackrong
8.9 GB7.5 tok/s131.5 tok/sRuns poorly

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

2 devices