Instructions to use wikeeyang/Flux2-Klein-9B-True-V3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use wikeeyang/Flux2-Klein-9B-True-V3 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("wikeeyang/Flux2-Klein-9B-True-V3", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Upload Flux2-Klein-9B-True-V3-INT8-ConvRot.safetensors
Browse filesINT8 quantized model with ConvRot (requires the nodes https://github.com/BobJohnson24/ComfyUI-INT8-Fast/) is much faster than the FP8 model on my RTX 4070 with 12GB VRAM; I believe it is approximately twice as fast.
The model was quantized using the same tools provided by the node developer on GitHub
con
| Configuration | Time per Iteration | Speedup |
| --- | --- | --- |
| INT8 ConvRot + SageAttention | 2.26 s/it | 🚀 2.48x faster |
| FP8 + SageAttention | 5.60 s/it | 1.00x (baseline) |
Note that it does not work well with torch compile (if you are using it, it might be better to disable it or check the author's GitHub)
As for whether it loses quality or not, I believe I understood that it even has better quality as long as it is ConvRot when compared to FP8. I don't know, I don't understand any of this technically; I compared it visually in ComfyUI and didn't see any appreciable loss or notable gain, things look very similar.
Could you add the file or convert it yourself? And also add it to the `readme.md` so people know they can use it; it supposedly works very well on older GPUs like the 3000 and 2000 series. Thank you very much for everything!!
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ff2f21d41dbfde4376658a6c38ac58562d2755137bfd802c9f46b40e899ad32d
|
| 3 |
+
size 9405843376
|