Instructions to use AhmedAyman/k2-think-cuda-1505 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use AhmedAyman/k2-think-cuda-1505 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("LLM360/K2-Think") model = PeftModel.from_pretrained(base_model, "AhmedAyman/k2-think-cuda-1505") - Notebooks
- Google Colab
- Kaggle
How to use LLaMAFactory's WebUI for Chat inference
#1
by SuponjiAyume - opened
I have downloaded your model locally, and also downloaded Qwen2.5-32B, set it up as shown in the picture, and the template selected qwen, but the answer seems to be looping all the time, and in the output of some content that I didn't mention, where is the problem with my settings? Thank you for your patience and guidance!