Transformers
GGUF
English
Llama-3.1
instruct
finetune
reasoning
hybrid-mode
chatml
function calling
tool use
json mode
structured outputs
atropos
dataforge
long context
roleplaying
chat
Instructions to use mradermacher/Hermes-4-405B-i1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/Hermes-4-405B-i1-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/Hermes-4-405B-i1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
uploaded from nico1
Browse files
.gitattributes
CHANGED
|
@@ -84,3 +84,6 @@ Hermes-4-405B.i1-Q3_K_S.gguf.part1of4 filter=lfs diff=lfs merge=lfs -text
|
|
| 84 |
Hermes-4-405B.i1-Q3_K_S.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 85 |
Hermes-4-405B.i1-Q3_K_S.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 86 |
Hermes-4-405B.i1-Q3_K_S.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
Hermes-4-405B.i1-Q3_K_S.gguf.part2of4 filter=lfs diff=lfs merge=lfs -text
|
| 85 |
Hermes-4-405B.i1-Q3_K_S.gguf.part3of4 filter=lfs diff=lfs merge=lfs -text
|
| 86 |
Hermes-4-405B.i1-Q3_K_S.gguf.part4of4 filter=lfs diff=lfs merge=lfs -text
|
| 87 |
+
Hermes-4-405B.i1-IQ2_XXS.gguf.part1of3 filter=lfs diff=lfs merge=lfs -text
|
| 88 |
+
Hermes-4-405B.i1-IQ2_XXS.gguf.part2of3 filter=lfs diff=lfs merge=lfs -text
|
| 89 |
+
Hermes-4-405B.i1-IQ2_XXS.gguf.part3of3 filter=lfs diff=lfs merge=lfs -text
|
Hermes-4-405B.i1-IQ2_XXS.gguf.part1of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0d0d52617689fcbae3b8b0bec8e177c2a263e4c5b530d5485b50b9e56d9ac4a1
|
| 3 |
+
size 36507222016
|
Hermes-4-405B.i1-IQ2_XXS.gguf.part2of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3581e6f807296d3e4e9fc888230e08704a85f1cb8dcfb7b109a22651fe5641c8
|
| 3 |
+
size 36507222016
|
Hermes-4-405B.i1-IQ2_XXS.gguf.part3of3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a9e3b8415019412c97b2f9592a12786db9682dad33e9bd7e7971eea89d3e1f1
|
| 3 |
+
size 34257923424
|