Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8

Base only

Active filters: group-size-32

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 144 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 42 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 59 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 60 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 18 • 1

TheHouseOfTheDude/GLM-4.7-Flash_AWQ

Text Generation • Updated Jan 29 • 48 • 3

lemuralabs/Qwen3.5-122B-A10B-Abliterated-MLX-3

Image-Text-to-Text • 19B • Updated about 4 hours ago • 86 • 1

masato25/Cosmos-Reason2-2B-Arbor-4bit-g32

Image-Text-to-Text • 0.7B • Updated Jun 2 • 122