llmat
/

Mistral-Small-24B-Instruct-2501-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

Mistral-Small-24B-Instruct-2501-NVFP4

15.2 GB

1 contributor

History: 5 commits

llmat's picture

Update README.md

d2b08cb verified 6 months ago

.gitattributes
271 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
README.md
1.61 kB

Update README.md 6 months ago
chat_template.jinja
1.6 kB

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
config.json
1.82 kB

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
generation_config.json
155 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
model-00001-of-00004.safetensors
5 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
model-00002-of-00004.safetensors
4.99 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
model-00003-of-00004.safetensors
3.86 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
model-00004-of-00004.safetensors
1.34 GB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
model.safetensors.index.json
109 kB

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
recipe.yaml
130 Bytes

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
special_tokens_map.json
21.3 kB

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
tokenizer.json
17.1 MB
xet

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago
tokenizer_config.json
198 kB

Add NVFP4 quantized model (llmcompressor oneshot). 6 months ago