Instructions to use ASaulters/voc-triage-llama3-8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use ASaulters/voc-triage-llama3-8b with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ASaulters/voc-triage-llama3-8b to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for ASaulters/voc-triage-llama3-8b to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for ASaulters/voc-triage-llama3-8b to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="ASaulters/voc-triage-llama3-8b", max_seq_length=2048, )
VoC Triage Llama-3-8B (LoRA Adapter)
Model Description
This is a Fine-Tuned LoRA Adapter for Llama-3-8B, specialized in IT Support Ticket Triage.
It takes raw user tickets and outputs structured JSON containing Priority, Tags, and Department.
Built with: Unsloth (2x faster training).
Intended Use
This model is designed to assist Help Desk teams by automating the initial categorization of support tickets.
- Input: "My mouse is broken and I can't click anything."
- Output:
Priority: Low,Tags: ['Hardware', 'Peripherals'],Department: IT Support.
How to Run
This is a LoRA adapter. You need to load it on top of the base Llama-3 model.
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "your-username/voc-triage-llama3-8b", # Replace with your repo!
max_seq_length = 2048,
dtype = None,
load_in_4bit = True,
)
FastLanguageModel.for_inference(model)
Model tree for ASaulters/voc-triage-llama3-8b
Base model
meta-llama/Meta-Llama-3-8B Quantized
unsloth/llama-3-8b-bnb-4bit