Transformers
GGUF
English
Llama-3.1
instruct
finetune
reasoning
hybrid-mode
chatml
function calling
tool use
json mode
structured outputs
atropos
dataforge
long context
roleplaying
chat
Instructions to use mradermacher/Hermes-4-405B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Hermes-4-405B-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Hermes-4-405B-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K
- 8.71 kB
- 47.2 GB xet
- 46.3 GB xet
- 42.9 GB xet
- 42.3 GB xet
- 46.2 GB xet
- 46.2 GB xet
- 44.3 GB xet
- 42.9 GB xet
- 42.9 GB xet
- 39.7 GB xet
- 40.8 GB xet
- 40.8 GB xet
- 37.7 GB xet
- 36.5 GB xet
- 36.5 GB xet
- 34.3 GB xet
- 46.2 GB xet
- 46.2 GB xet
- 46.2 GB xet
- 43.2 GB xet
- 44 GB xet
- 44 GB xet
- 44 GB xet
- 43.4 GB xet
- 41.9 GB xet
- 41.9 GB xet
- 41.9 GB xet
- 40.4 GB xet
- 39.7 GB xet
- 39.7 GB xet
- 39.7 GB xet
- 36.7 GB xet
- 44 GB xet
- 44 GB xet
- 44 GB xet
- 44 GB xet
- 40.5 GB xet
- 37.6 GB xet
- 37.6 GB xet
- 37.6 GB xet
- 36.6 GB xet
- 46.2 GB xet
- 46.2 GB xet
- 45.4 GB xet
- 42.9 GB xet
- 42.9 GB xet
- 42.9 GB xet
- 42.9 GB xet
- 41 GB xet