lllyasviel
/

omost-dolphin-2.9-llama3-8b-4bits

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

omost-dolphin-2.9-llama3-8b-4bits is Omost's llama3-8b model with dolphin-2.9 instruct pretraining in nf4.

Downloads last month: 35

Safetensors

Model size

5B params

Tensor type

BF16

·

F32

·

U8

·