Liquid AI
Liquid AI/LFM2-2.6B

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q4_k_mGGML's logo.
Liquid AI
Liquid AI		1.5 GB35.5 tok/s355.1 tok/sRuns ok

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

1 device