Hugging Face's logo

sszymczyk
/
snowflake-arctic-instruct-gqa-GGUF

GGUF
conversational
Model card Files
xet
Community
sszymczyk commited on
Commit
1d8d5c6
·
verified ·
1 Parent(s): 682e53b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -5,6 +5,4 @@ license: apache-2.0
5
  Quantized version of https://huggingface.co/Snowflake/snowflake-arctic-instruct
6
 
7
  Created from commit be318cae5aba5291208f27d30991a5150500887d.
8
- The original model was changed due to fixes for GQA support, so I decided to convert it again.
9
-
10
- There is no support for this in mainline llama.cpp yet. You have to use snowflake-arctic branch: https://github.com/fairydreaming/llama.cpp/tree/snowflake-arctic
 
5
  Quantized version of https://huggingface.co/Snowflake/snowflake-arctic-instruct
6
 
7
  Created from commit be318cae5aba5291208f27d30991a5150500887d.
8
+ The original model was changed due to fixes for GQA support, so I decided to convert it again.