Instructions to use chchen/Gemma-2-9B-It-SAA-Half with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use chchen/Gemma-2-9B-It-SAA-Half with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-9b-it") model = PeftModel.from_pretrained(base_model, "chchen/Gemma-2-9B-It-SAA-Half") - Notebooks
- Google Colab
- Kaggle
| { | |
| "epoch": 2.986666666666667, | |
| "eval_logits/chosen": 0.13058120012283325, | |
| "eval_logits/rejected": 0.3316400647163391, | |
| "eval_logps/chosen": -1.0981853008270264, | |
| "eval_logps/rejected": -1.93387770652771, | |
| "eval_loss": 1.138285517692566, | |
| "eval_odds_ratio_loss": 10.197811126708984, | |
| "eval_rewards/accuracies": 0.8399999737739563, | |
| "eval_rewards/chosen": -0.10981854796409607, | |
| "eval_rewards/margins": 0.0835692435503006, | |
| "eval_rewards/rejected": -0.19338779151439667, | |
| "eval_runtime": 3.5214, | |
| "eval_samples_per_second": 14.199, | |
| "eval_sft_loss": 0.11850442737340927, | |
| "eval_steps_per_second": 7.099 | |
| } |