thank you for this quant, hope to get some benchmark to compare this quant with the full weight and fp8
Unfortunately the full size don't fit in my VRAM so I'll leave the benchmarking to others.
· Sign up or log in to comment
