random-stuff
Collection
16 items • Updated
How to use MuXodious/Goetia-26B-A4B-v1.4-Lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("MuXodious/gemma-4-26B-A4B-it-text-only")
model = PeftModel.from_pretrained(base_model, "MuXodious/Goetia-26B-A4B-v1.4-Lora")This is a LoRA extracted from a language model. It was extracted using mergekit.
This LoRA adapter was extracted from Goetia-26B-A4B-v1.4-text-only and uses gemma-4-26B-A4B-it-text-only as a base.
The following command was used to extract this LoRA adapter:
mergekit-extract-lora --model Goetia-26B-A4B-v1.4-text-only --base-model gemma-4-26B-A4B-it-text-only --out-path ./goetia_lora --max-rank 64 --cuda -e vision -e lm_head
Base model
Naphula/Goetia-26B-A4B-v1.4