Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

19

Base only

Active filters: quantllm

codewithdark/Llama-3.2-3B-4bit

3B • Updated Dec 18, 2025 • 16

codewithdark/Llama-3.2-3B-GGUF-4bit

3B • Updated Dec 19, 2025 • 17

codewithdark/Llama-3.2-3B-4bit-mlx

Text Generation • 3B • Updated Dec 19, 2025 • 10

QuantLLM/Llama-3.2-3B-4bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 16

QuantLLM/Llama-3.2-3B-2bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 16

QuantLLM/Llama-3.2-3B-8bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 28

QuantLLM/Llama-3.2-3B-5bit-mlx

Text Generation • 3B • Updated Dec 20, 2025 • 15

QuantLLM/Llama-3.2-3B-5bit-gguf

3B • Updated Dec 20, 2025 • 15

QuantLLM/Llama-3.2-3B-2bit-gguf

3B • Updated Dec 20, 2025 • 20

QuantLLM/functiongemma-270m-it-8bit-gguf

0.3B • Updated Dec 21, 2025 • 15 • 1

QuantLLM/functiongemma-270m-it-4bit-gguf

0.3B • Updated Dec 21, 2025 • 61

QuantLLM/functiongemma-270m-it-4bit-mlx

Text Generation • 0.3B • Updated Dec 21, 2025 • 19

QuantLLM/Meta-Llama-3-70B-Instruct-4bit-gguf

Text Generation • 71B • Updated Apr 24 • 8 • 1

QuantLLM/Qwen3-0.6B-2bit-gguf

0.6B • Updated Apr 25 • 11

QuantLLM/Qwen3-0.6B-4bit-gguf

0.6B • Updated Apr 25 • 21

QuantLLM/Qwen3-0.6B-8bit-gguf

0.6B • Updated Apr 25 • 15

QuantLLM/TinyLlama-1.1B-Chat-GGUF

1B • Updated Apr 29 • 12

QuantLLM/SmolLM2-135M-QuantLLM

Text Generation • 0.1B • Updated Apr 29 • 11

QuantLLM/SmolLM2-135M-GGUF

0.1B • Updated Apr 29 • 53 • 1