LocalAI-Llama3.1-8b-Function-Call-v0.3

local-ai-banner.png

LocalAIFCALL

This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.

Specifically, the model once enters in tools mode will always reply with JSON.

Downloads last month
8
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mudler/LocalAI-Llama3.1-8b-Function-Call-v0.3

Quantizations
2 models