Transformers
GGUF
English
Llama-3.1
instruct
finetune
reasoning
hybrid-mode
chatml
function calling
tool use
json mode
structured outputs
atropos
dataforge
long context
roleplaying
chat
Instructions to use mradermacher/Hermes-4-405B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Hermes-4-405B-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Hermes-4-405B-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 613ee3f2d63cda86dc04e34d0ed30dff76c7710d53fac27d54a2d95b41e38c57
- Size of remote file:
- 39.7 GB
- SHA256:
- d742c76f7eb0c5a2280cf46b5a50e35a840583fe38d5fa46239379fbf02ed59e
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.