Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

214

Base only

Active filters: distilled

Abigail45/Chyio

Text Generation • Updated Dec 11, 2025

hamadbijarani012/TinyBERT_General_4L_312D_distilled_BERT_base_uncased_SST2_int8

Text Classification • 14.4M • Updated Dec 20, 2025 • 28

webxos/microd_v1

Text Generation • Updated Jan 5 • 27 • 3

ayousanz/uZipVoice-onnx

Text-to-Speech • Updated Jan 12

Savyasaachin/gemma-3-4b-it-claude-Q4_K_M-GGUF

4B • Updated Jan 15 • 59

mradermacher/AclevoGPT-100M-Instruct-GGUF

0.1B • Updated Jan 22 • 124 • 1

mradermacher/AclevoGPT-100M-Instruct-i1-GGUF

0.1B • Updated Jan 22 • 187

hbfreed/flex-math-2048

Text Generation • 8B • Updated Mar 10 • 7

hbfreed/flex-general-2048

Text Generation • 8B • Updated Mar 10 • 10

hbfreed/flex-math-5504

Text Generation • 9B • Updated Mar 10 • 9

hbfreed/flex-math-8192

Text Generation • 11B • Updated Mar 10 • 16

mradermacher/AlgoMind-1.2B-GGUF

Text Generation • 1B • Updated Feb 1 • 177

mradermacher/AlgoMind-1.2B-i1-GGUF

Text Generation • 1B • Updated Feb 1 • 468

mradermacher/GLM4.7-Distill-LFM2.5-1.2B-GGUF

Text Generation • 1B • Updated Feb 2 • 102 • 1

mradermacher/GLM4.7-Distill-LFM2.5-1.2B-i1-GGUF

Text Generation • 1B • Updated Feb 2 • 269 • 3

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8

Text-to-Image • 83B • Updated Feb 9 • 34 • 2

iitolstykh/VIBE-Image-Edit-DistilledCFG

Image-to-Image • 2B • Updated Feb 9 • 25 • 10

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4

Text-to-Image • 83B • Updated Feb 9 • 61 • 2

kwonhan/GLM4.7-Distill-LFM2.5-1.2B-mlx

Text Generation • 1B • Updated Feb 10 • 25

voiceping-ai/whisper-ja-en-speech-translation

Automatic Speech Recognition • 0.8B • Updated Feb 16 • 61

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 2.48k • 15

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 1.35k • 8

Open4bits/Kai-3B-Instruct-GGUF

Text Generation • 3B • Updated Mar 2 • 39

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-6bit

27B • Updated Mar 6 • 863 • 29

KARAGE-KUN/Qwen3.5-0.8b-distill-4b

0.9B • Updated Mar 5 • 7

Abiray/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled

9B • Updated Mar 9 • 10 • 3

Abiray/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled-GGUF

9B • Updated Mar 9 • 335 • 3

Abiray/Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled

5B • Updated Mar 9 • 8 • 2

Abiray/Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled-GGUF

4B • Updated Mar 10 • 194

mradermacher/Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled-GGUF

4B • Updated Apr 13 • 308 • 1