Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

403

Base only

Active filters: local-ai

shafire/Zero-Gemma4-E4B-OpenZero-GGUF

Text Generation • 8B • Updated 3 days ago • 2.45k • 4

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated Jun 7 • 17.9k • 62

Agnuxo/Qwen2-1.5B-Instruct_MOE_CODE_assistant-GGUF_4bit

Text Generation • 2B • Updated May 10 • 220 • 1

mradermacher/cajal-9b-v2-full-GGUF

Text Generation • 9B • Updated May 11 • 148 • 2

mradermacher/cajal-9b-v2-full-i1-GGUF

Text Generation • 9B • Updated May 11 • 3.3k • 1

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 8B • Updated Jun 7 • 1.31k • 7

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed

Text Generation • 9B • Updated Jun 11 • 1.64k • 4

mradermacher/Kepler-Reasoning-7B-GGUF

8B • Updated about 1 month ago • 289 • 1

mradermacher/Kepler-Reasoning-7B-i1-GGUF

8B • Updated about 1 month ago • 1.49k • 1

mradermacher/turbo-ai-7b-i1-GGUF

Summarization • 8B • Updated 23 days ago • 1.86k • 1

Jonandrop/Ornith-1.0-35B-MTPLX-Vision

Image-Text-to-Text • 35B • Updated 16 days ago • 664 • 1

shafire/Zero-Qwen3-8B-OpenZero-GGUF

Text Generation • 8B • Updated 3 days ago • 1.78k • 1

veyra-ai/Veyra-30M-Instruct-ONNX

Text Generation • Updated 4 days ago • 46 • 1

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebula

Text Generation • Updated May 10

Agnuxo/Mistral-NeMo-Minitron-8B-Base-Nebulal

Text Generation • Updated May 10 • 14

Agnuxo/Mistral-NeMo-Minitron-8B-Base-CODE-Python

Text Generation • Updated May 10 • 7

mradermacher/Mistral-NeMo-Minitron-8B-Base-Nebulal-GGUF

Text Generation • 8B • Updated Jun 13 • 105

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-8bit

Text Generation • 8B • Updated May 10 • 110

Agnuxo/Mistral-NeMo-Minitron-8B-Alpaca-CODE-Python-GGUF-16bit

Text Generation • 8B • Updated May 10 • 141

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-4bit

Text Generation • Updated May 10

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-16bit

Text Generation • Updated May 10 • 5 • 1

Agnuxo/Meta-Llama-3.1-8B-CODE-Alpaca-Python-8bit-GGUF

Text Generation • 8B • Updated May 10 • 60

Agnuxo/Meta-Llama-3.1-8B-CODE-Python-Alpaca-Lora

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-lora_model

Text Generation • Updated May 10

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant_16bit

Text Generation • 4B • Updated May 10 • 12

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_8bit

Text Generation • 4B • Updated May 10 • 231

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_16bit

Text Generation • 4B • Updated May 10 • 747 • 3

Agnuxo/Phi-3.5-mini-instruct-python_coding_assistant-GGUF_4bit

Text Generation • 4B • Updated May 10 • 867

Agnuxo/Mamba-Codestral-7B-v0.1-python_coding_assistant_16bit

Text Generation • 7B • Updated May 10 • 22

Agnuxo/Mamba-Codestral-7B-v0.1-lora_model

Text Generation • Updated May 10