Why so few 8 bit capable models?
1
#13 opened over 2 years ago
by
ibivibiv
Can Run "gptq_model-4bit--1g" but not "gptq-4bit-32g-actorder_True"
#12 opened over 2 years ago
by
0-hero
comparison with bitsandbytes nf4, hope to increase GPTQ accuracy
12
#11 opened over 2 years ago
by
AIReach
Mininum VRAM?
7
#9 opened over 2 years ago
by
hierholzer
GGML version possible/coming?
2
#8 opened over 2 years ago
by
Thireus
vram requirements
👍
1
1
#5 opened over 2 years ago
by
joujiboi