Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

632

Base only

Active filters: gguf-my-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

88.1M • Updated Nov 1, 2024 • 29 • 1

ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

90.9M • Updated Jan 8, 2025 • 76 • 4

ggml-org/LoRA-Qwen2.5-14B-Instruct-abliterated-v2-F16-GGUF

0.3B • Updated Jan 8, 2025 • 22 • 2

ggml-org/LoRA-Qwen2.5-Coder-7B-Instruct-F16-GGUF

0.2B • Updated Jan 8, 2025 • 17 • 1

ggml-org/LoRA-Qwerus-Qwen2.5-7B-Instruct-F16-GGUF

90.9M • Updated Jan 8, 2025 • 16 • 1

ggml-org/LoRA-Deepthink-Reasoning-7B-F16-GGUF

0.2B • Updated Jan 8, 2025 • 54 • 2

ggml-org/LoRA-Llama-3.1-8B-MultiReflection-F16-GGUF

0.2B • Updated Jan 8, 2025 • 26 • 1

ggml-org/LoRA-phi-4-abliterated-F16-GGUF

0.1B • Updated Jan 9, 2025 • 29 • 3

ggml-org/LoRA-SmallThinker-3B-Preview-F16-GGUF

0.1B • Updated Jan 9, 2025 • 8 • 1

ggml-org/LoRA-Deepthink-Reasoning-Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • 40.4M • Updated Jan 15, 2025 • 89 • 2

ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

93.6M • Updated Jan 23, 2025 • 85 • 5

Azraell/qwen2.5-coder-7b-magicoder-lora-Q8_0-GGUF

40.4M • Updated Jul 6 • 43 • 2

bunnycore/LLama-3.2-1B-General-lora_model-F16-GGUF

11.3M • Updated Nov 1, 2024 • 54 • 1

bunnycore/Qwen2.5-7B-Exp2-lora_model-Q8_0-GGUF

40.4M • Updated Nov 3, 2024 • 20 • 1

Leejy0-0/Llama-3.2-3b-lora_model-F16-GGUF

24.3M • Updated Nov 4, 2024 • 6

PragmaticPete/llama3.2inst-F32-GGUF

Text Generation • 90.2M • Updated Nov 4, 2024 • 9

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F16-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 10 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-F32-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 10 • 1

NikolayKozloff/Phi-3-medium-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • 65.5M • Updated Nov 5, 2024 • 6 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F32-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 12 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-F16-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 18 • 1

NikolayKozloff/Phi-3-mini-4k-instruct-sq-LORA-Q8_0-GGUF

Text Generation • 29.9M • Updated Nov 5, 2024 • 9 • 1

dimvasilk/Llama-3-Instruct-abliteration-LoRA-8B-F16-GGUF

88.1M • Updated Nov 11, 2024 • 7

Mortido/saiga_mistral_7b_lora-F16-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 23

Mortido/saiga_mistral_7b_lora-F32-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 15

Mortido/saiga_mistral_7b_lora-Q8_0-GGUF

Text Generation • 13.6M • Updated Nov 11, 2024 • 18

shafire/AgentZero-F16-GGUF

Text Generation • 54M • Updated Jun 12, 2025 • 26

shafire/AgentZero-Q8_0-GGUF

Text Generation • 54M • Updated Jun 12, 2025 • 14

JackeyLai/Qwen2.5-3B-instruct-lora-F16-GGUF

15M • Updated Nov 12, 2024 • 22

shafire/talktoai-F16-GGUF

Text Generation • 41.9M • Updated Jun 12, 2025 • 16