Transformers
GGUF
English
Llama-3.1
instruct
finetune
reasoning
hybrid-mode
chatml
function calling
tool use
json mode
structured outputs
atropos
dataforge
long context
roleplaying
chat
Instructions to use mradermacher/Hermes-4-405B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Hermes-4-405B-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Hermes-4-405B-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -70,3 +70,8 @@ Hermes-4-405B.i1-Q6_K.gguf.part4of7 filter=lfs diff=lfs merge=lfs -text
|
|
| 70 |
Hermes-4-405B.i1-Q6_K.gguf.part5of7 filter=lfs diff=lfs merge=lfs -text
|
| 71 |
Hermes-4-405B.i1-Q6_K.gguf.part6of7 filter=lfs diff=lfs merge=lfs -text
|
| 72 |
Hermes-4-405B.i1-Q6_K.gguf.part7of7 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
Hermes-4-405B.i1-Q6_K.gguf.part5of7 filter=lfs diff=lfs merge=lfs -text
|
| 71 |
Hermes-4-405B.i1-Q6_K.gguf.part6of7 filter=lfs diff=lfs merge=lfs -text
|
| 72 |
Hermes-4-405B.i1-Q6_K.gguf.part7of7 filter=lfs diff=lfs merge=lfs -text
|
| 73 |
+
Hermes-4-405B.i1-IQ4_XS.gguf.part1of5 filter=lfs diff=lfs merge=lfs -text
|
| 74 |
+
Hermes-4-405B.i1-IQ4_XS.gguf.part2of5 filter=lfs diff=lfs merge=lfs -text
|
| 75 |
+
Hermes-4-405B.i1-IQ4_XS.gguf.part3of5 filter=lfs diff=lfs merge=lfs -text
|
| 76 |
+
Hermes-4-405B.i1-IQ4_XS.gguf.part4of5 filter=lfs diff=lfs merge=lfs -text
|
| 77 |
+
Hermes-4-405B.i1-IQ4_XS.gguf.part5of5 filter=lfs diff=lfs merge=lfs -text
|
Hermes-4-405B.i1-IQ4_XS.gguf.part1of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8a55d3447255c67030edea5a9209fcbaff9f7126162b703a13b1c19b2f3224e0
|
| 3 |
+
size 44023414784
|
Hermes-4-405B.i1-IQ4_XS.gguf.part2of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:25cd05997c6324e11d4cd5e2db5c84bb5ea42ba50cafd0fa13ccbf739c8d7de6
|
| 3 |
+
size 44023414784
|
Hermes-4-405B.i1-IQ4_XS.gguf.part3of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64aa59f588c45286b4fc1dbd841a882fa495d4dd780ee33f9461335f66d7502c
|
| 3 |
+
size 44023414784
|
Hermes-4-405B.i1-IQ4_XS.gguf.part4of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dd07ae019747b00f36f4f819f2e661998fa9ca704969c748a9e171bb3129a44c
|
| 3 |
+
size 44023414784
|
Hermes-4-405B.i1-IQ4_XS.gguf.part5of5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ee13d2315ff092e2e4d7ea03a9e646ae49d80d45bf32de16c21180e581556f80
|
| 3 |
+
size 40475946336
|