Liquid AI
Liquid AI/LFM2-8B-A1B

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q4_0GGML's logo.
Liquid AI
Liquid AI		4.4 GB28.8 tok/s280.4 tok/sRuns ok

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

1 device