Transformers
GGUF
English
Llama-3.1
instruct
finetune
reasoning
hybrid-mode
chatml
function calling
tool use
json mode
structured outputs
atropos
dataforge
long context
roleplaying
chat
Instructions to use mradermacher/Hermes-4-405B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Hermes-4-405B-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Hermes-4-405B-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -75,3 +75,6 @@ Hermes-4-405B.i1-IQ4_XS.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
|
| 75 |
Hermes-4-405B.i1-IQ4_XS.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 76 |
Hermes-4-405B.i1-IQ4_XS.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 77 |
Hermes-4-405B.i1-IQ4_XS.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 75 |
Hermes-4-405B.i1-IQ4_XS.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 76 |
Hermes-4-405B.i1-IQ4_XS.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 77 |
Hermes-4-405B.i1-IQ4_XS.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
| 78 |
+
Hermes-4-405B.i1-Q2_K_S.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 79 |
+
Hermes-4-405B.i1-Q2_K_S.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 80 |
+
Hermes-4-405B.i1-Q2_K_S.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
Hermes-4-405B.i1-Q2_K_S.gguf.part1of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2a7986e454ec6fc5e9a79ce2a5651970ee31b4eba262393b2347b1d5dc96df38
|
| 3 |
+
size 46170898432
|
Hermes-4-405B.i1-Q2_K_S.gguf.part2of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:047cca2a613374796d5dff7c5dc8787ba4cc42a431ac6254581cc3fce8a4fae5
|
| 3 |
+
size 46170898432
|
Hermes-4-405B.i1-Q2_K_S.gguf.part3of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eb3df035734002ac354430d711f1d9483d584ce857dc0787e2255a27e444d531
|
| 3 |
+
size 45448752480
|