Jackrong
Jackrong/Gemopus 4 26B A4B IT

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q4_k_mGGML's logo.
Jackrong
Jackrong		15.6 GB57.6 tok/s678.3 tok/sRuns ok

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

1 device