Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.
Llama.cpp does not support MTP heads, but vLLM does.
- Downloads last month
- 7
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for pdelobelle/DeepSeek-R1-GGUF-MTP
Base model
deepseek-ai/DeepSeek-R1