How to quantize a model?
#1
by gabbo1995 - opened
Hi! Thanks for your work and all the models you provide.
I am a bit confused about how to quantize a fine tune of SDXL I own.
Is there a folder you can point me of examples about quantizing models? What are the requirements needed?
Thank you very much!
Just enable SDNQ quantization in quantization settings and save the model after it is done loading from models -> save.
https://github.com/vladmandic/sdnext/wiki/SDNQ-Quantization
Thank you!