thisnick
/

DeepSeek-R1-Distill-Llama-70B-abliterated-FP8-Dynamic

compressed-tensors

Model card Files Files and versions

DeepSeek-R1-Distill-Llama-70B-abliterated-FP8-Dynamic

This is a quantized version of thisnick/DeepSeek-R1-Distill-Llama-70B-abliterated using FP8 quantization.

Downloads last month: -

Safetensors

Model size

71B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support