Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

353

Base only

Active filters: local-llm

yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jun 19 • 380k • 1.36k

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 19 • 299k • 2.79k

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated 4 days ago • 56.2k • 63

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated 4 days ago • 21k • 36

huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated-GGUF

Text Generation • 12B • Updated Jun 22 • 5.95k • 28

m15dg/local-ai-toolkit

Text Generation • 35B • Updated 15 days ago • 44k • 30

vinpix/Ternary-Bonsai-27B-Stock-MTP-GGUF

Text Generation • 29B • Updated 7 days ago • 3.89k • 5

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated 4 days ago • 3.04k • 33

tngtech/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated 7 days ago • 3.2k • 3

samwang0041/Qwen3.6-27B-MLX-4bit-MTP

Text Generation • 27B • Updated May 16 • 851 • 5

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

Text Generation • 12B • Updated Jun 18 • 12.7k • 118

Buck2222/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 15 • 1.61k • 13

mradermacher/gemma-4-12B-coder-fable5-composer2.5-v1-bf16-i1-GGUF

12B • Updated about 1 month ago • 1.26k • 1

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated Jun 26 • 4.48k • 16

gijl/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated 28 days ago • 916 • 2

Tendrun/qwen3.6-27b-django-coder-gguf

Text Generation • 27B • Updated 24 days ago • 508 • 1

liodon-ai/VulnLLM-R-7B-imatrix-GGUF

Text Generation • 8B • Updated 11 days ago • 189 • 1

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated 4 days ago • 695 • 1

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated 4 days ago • 666 • 27

McaTech/Nonet

Text Generation • 0.1B • Updated Jun 30, 2025 • 207 • 3

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 17

umar141/gemma-3-Baro-finetune-v2-gguf

4B • Updated Apr 13, 2025 • 49 • 1

umar141/gemma-3-Baro-finetune-v3-gguf

4B • Updated Apr 17, 2025 • 135

dwili/gemma3-1b-ringkasan-bahasa-indo-gguf

1.0B • Updated Jun 29, 2025 • 28 • 1

Hussain2050/GGUF-Loader

shiv1119/ollama-model-shiv

Text Generation • Updated Jul 23, 2025

hedachi/LLM_Battle

Updated Aug 18, 2025 • 6

gpsworld/gpsworld

Text Generation • 3B • Updated Sep 2, 2025 • 1

neuralcrew/neutrino-instruct

Text Generation • 7B • Updated 17 days ago • 40.3k • 7

Manojb/Qwen3-4B-toolcalling-gguf-codex

Text Generation • 4B • Updated Sep 21, 2025 • 2.66k • 55