Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,089

Base only

Active filters: llama.cpp

AtomicChat/Ling-3.0-flash-NVFP4-GGUF

Text Generation • 124B • Updated 2 days ago • 262 • 3

Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Image-Text-to-Text • 27B • Updated 30 days ago • 78.4k • 678

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 70.8k • 765

Jackrong/Qwen3.5-9B-GLM5.1-Distill-v1-GGUF

Image-Text-to-Text • 9B • Updated 30 days ago • 28.7k • 112

WithinUsAI/Opus4.7-GODs.Ghost.Codex-4B.GGuF

Text Generation • 4B • Updated Jun 19 • 3.22k • 99

hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 19 • 46.2k • 289

AtomicChat/gemma-4-26B-A4B-it-assistant-GGUF

Text Generation • 0.4B • Updated 15 days ago • 3.06k • 29

OBLITERATUS/Qwen3.6-27B-OBLITERATED

Text Generation • 27B • Updated May 23 • 15.2k • 189

Jackrong/Qwopus3.6-27B-v2-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 30 days ago • 48.8k • 389

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated Jun 1 • 1.3k • 30

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

Text Generation • 12B • Updated Jun 18 • 10.3k • 120

JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q4_K_M

Text Generation • 12B • Updated Jun 4 • 13.1k • 13

yuxinlu1/Mellum2-12B-A2.5B-Claude-4.6-4.8-Opus-Thinking-GGUF

Text Generation • 12B • Updated Jun 9 • 2.69k • 35

SupraLabs/Supra-Title-350M-exp-GGUF

Feature Extraction • 0.4B • Updated 9 days ago • 775 • 47

fableforge-ai/ReasonCritic-7B

Text Generation • Updated 22 days ago • 1.76k • 4

empero-ai/Qwable-9B-Claude-Fable-5-GGUF

Image-Text-to-Text • 9B • Updated Jun 19 • 22.2k • 77

King3Djbl/mythos-9b-unhinged

Text Generation • 8B • Updated 22 days ago • 15.1k • • 28

poolside/Laguna-XS-2.1-GGUF

Text Generation • 33B • Updated 20 days ago • 52.2k • 80

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 21 days ago • 9.27k • 17

kai-os/Grug-12B-GGUF

Text Generation • 12B • Updated Jul 2 • 652 • 12

mradermacher/ReasonCritic-7B-GGUF

Text Generation • 8B • Updated Jul 7 • 468 • 2

mradermacher/ReasonCritic-7B-i1-GGUF

Text Generation • 8B • Updated Jul 7 • 1.54k • 2

Frosty40/Ornith-1.0-35B-B70-Turbo

Text Generation • 35B • Updated Jul 3 • 120 • 2

satgeze/Ornith-1.0-9B-1M-GGUF

Text Generation • 0.5B • Updated 23 days ago • 2.41k • 7

huihui-ai/Huihui-Ornith-1.0-35B-abliterated-GGUF

Text Generation • 35B • Updated Jul 5 • 17.2k • 16

satgeze/Qwen3.6-35B-Uncensored-HauhauCS-1M-GGUF

Text Generation • 0.4B • Updated 28 days ago • 5.68k • 6

el4/Darwin-36B-Opus-OPAL-GGUF

Text Generation • 35B • Updated 29 days ago • 17.7k • 16

migtissera/Tess-4-27B-GGUF

Image-Text-to-Text • 27B • Updated 29 days ago • 29k • 36

Brian6145/Qwen3.6-27B-Claude-Opus-DeepSeek-Distilled-Imatrix-MTP-GGUF

Text Generation • 27B • Updated 25 days ago • 41.9k • 18

hauser458b/lfm2.5-230m-code-math-GGUF

Text Generation • 0.2B • Updated 9 days ago • 855 • 5