Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

70

Base only

Active filters: cerebras

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 12.8k • 67

plezan/MiniMax-M2.1-REAP-50-W4A16

Text Generation • 17B • Updated Jan 14 • 28 • 5

0xSero/Gemma-4-21B

Text Generation • 21B • Updated May 30 • 838 • 102

EmanuelOverride/gemma-4-26B-A4B-it-heretic-APEX-GGUF

Text Generation • 25B • Updated 2 days ago • 25.6k • 2

SebastianSchramm/Cerebras-GPT-111M-instruction

Text Generation • 0.1B • Updated Nov 28, 2023 • 12 • 3

cerebras/Llama3-DocChat-1.0-8B

Text Generation • Updated Aug 16, 2024 • 21 • • 69

NikolayKozloff/Llama3-DocChat-1.0-8B-Q8_0-GGUF

Text Generation • 8B • Updated Aug 21, 2024 • 4 • 6

mattritchey/Llama3-DocChat-1.0-8B-IQ4_NL-GGUF

Text Generation • 8B • Updated Aug 22, 2024 • 5

mattritchey/Llama3-DocChat-1.0-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 22, 2024 • 6

QuantFactory/Llama3-DocChat-1.0-8B-GGUF

Text Generation • 8B • Updated Aug 24, 2024 • 448 • 1

bartowski/Llama3-DocChat-1.0-8B-GGUF

Text Generation • 8B • Updated Aug 30, 2024 • 785

mradermacher/Llama3-DocChat-1.0-8B-GGUF

8B • Updated Jan 22, 2025 • 47 • 1

mradermacher/Llama3-DocChat-1.0-8B-i1-GGUF

8B • Updated Jan 22, 2025 • 183 • 1

cerebras/Llama-3-CBHybridL-8B

Text Generation • 8B • Updated Mar 26, 2025 • 6

MatteoKhan/Cerebras-OPT-Fusion

Text Generation • 7B • Updated Apr 10, 2025 • 9

cerebras/Llama-3-CBHybridM-8B

Text Generation • 8B • Updated Mar 26, 2025 • 11

mradermacher/Cerebras-OPT-Fusion-GGUF

7B • Updated Mar 5, 2025 • 46

mradermacher/Cerebras-OPT-Fusion-i1-GGUF

7B • Updated Mar 5, 2025 • 227

mradermacher/Cerebras-GPT-111M-instruction-GGUF

0.1B • Updated Jul 11, 2025 • 67

mradermacher/Cerebras-GPT-111M-instruction-i1-GGUF

0.1B • Updated Jul 11, 2025 • 198 • 1

0xSero/GLM-4.6-218B-W4A16

Text Generation • 2B • Updated May 30 • 11 • 8

0xSero/GLM-4.7-REAP-40-W4A16

Text Generation • 2B • Updated May 30 • 90 • 7

0xSero/GLM-4.7-185B

Text Generation • 185B • Updated May 30 • 26 • 19

0xSero/GLM-4.7-185B-W4A16

Text Generation • 2B • Updated May 30 • 71 • 69

0xSero/GLM-4.7-202B

Text Generation • 202B • Updated May 30 • 19 • 2

0xSero/DeepSeek-V3.2-345B-W3A16

Text Generation • 2B • Updated May 30 • 19 • 10

mlx-community/GLM-4.7-REAP-50-mixed-3-4-bits

Text Generation • 185B • Updated Jan 4 • 148 • 3

bullerwins/MiniMax-M2.1-REAP-50-GGUF

Text Generation • 116B • Updated Jan 5 • 53 • 1

mradermacher/MiniMax-M2.1-REAP-50-GGUF

116B • Updated Jan 11 • 70 • 5

dolaloichua/GLM-4.7-REAP-50-mlx-4Bit

Text Generation • 185B • Updated Jan 6 • 36