tkwiecinski/amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42
amr-fma training run.
- Method:
lora_sdpo - Base model:
mistralai/Mistral-7B-Instruct-v0.3 - Dataset:
DigitalLearningGmbH/MATH-lighteval(slug:math) - Seed:
42 - Git commit:
8b979a30de6dfbf3b5a1052e42d8c0453b214d3f - Exp name:
p1_sdpo_math_l3plus - WandB run:
02olkt1m
Tags
- phase:P1
- domain:math
Checkpoints (branches)
- step 1 → revision
step-00001 - step 3 → revision
step-00003 - step 6 → revision
step-00006 - step 12 → revision
step-00012 - step 22 → revision
step-00022 - step 42 → revision
step-00042 - step 79 → revision
step-00079 - step 80 → revision
step-00080
Pin a specific checkpoint with revision=... in
AutoModelForCausalLM.from_pretrained / PeftModel.from_pretrained.
Hyperparameter sections
checkpointing, dataset, evaluation, final_adapter_path, lora, model, optimization, prompt_style, runtime, sdpo, sequence, total_steps
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for tkwiecinski/amr-fma-Mistral-7B-Instruct-v0.3-lora_sdpo-math-p1_sdpo_math_l3plus-s42
Base model
mistralai/Mistral-7B-v0.3 Finetuned
mistralai/Mistral-7B-Instruct-v0.3