unsloth

/

Llama-3.1-8B-Instruct-FP8-Block

like 1

Follow

Unsloth AI 12k

This FP8-Block quant of Llama-3.1-8B-Instruct is good! I converted it to GGUF Q8_0. And, it is like a night and day contrast between the FP8-Block and the FP8-Dynamic. Although, it seems like the FP8-Dynamic has its moments where it outshines the former. I really like both of these quants. 😋