Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

505

Base only

Active filters: w4a16

LeaderboardModel1/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-AutoRound-W4A16-Tuning

Text Generation • 6B • Updated 9 days ago • 265 • 1

LeaderboardModel1/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-Tess-AutoRound-W4A16-Tuning

Text Generation • 3B • Updated 9 days ago • 23

LeaderboardModel1/KAT-Coder-V2.5-Dev-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated 9 days ago • 765

sapidlabs/Sparkulator-Laguna-XS-2.1

Text Generation • 0.5B • Updated 8 days ago • 29

LeaderboardModel1/Tess-4-35B-A3B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated 8 days ago • 25

sapidlabs/Sparkulator-Laguna-S-2.1-NVFP4

Text Generation • 1B • Updated 8 days ago • 48

0xTank/SuperGLM-5.2-v2-W4W8-Overlay

Text Generation • Updated 8 days ago • 1

DoktorMincs/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-W4A16-AutoRound

28B • Updated 8 days ago • 105

sapidlabs/Sparkulator-Gemma-4-26B-A4B

0.4B • Updated 8 days ago • 23

labeebaryan/Qwen3.5-0.8B-Base-CliffQuant-W4A16-G128

Image-Text-to-Text • 0.9B • Updated 7 days ago • 27

yuesheng123/MiniCPM-o-4.5-W4A16

Image-Text-to-Text • 9B • Updated 7 days ago • 19

sahilchachra/Mage-VL-AWQ

Image-Text-to-Text • 5B • Updated 5 days ago • 580

LeaderboardModel1/Escarda-86M-Base-AutoRound-W4A16-RTN

Text Generation • 91.2M • Updated 6 days ago • 29

ajh-code/Mage-VL-XPO3-NVFP4-W4A4

Image-Text-to-Text • 3B • Updated 2 days ago • 342

LeaderboardModel1/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-AutoRound-W4A16-Tuning

Text Generation • 6B • Updated 4 days ago • 25

taurusduan/GLM-5.2-W4A16

Text Generation • 101B • Updated 4 days ago • 48

LeaderboardModel1/GRM-3.2-Turf-AutoRound-W4A16-Tuning

Text Generation • 0.3B • Updated 3 days ago • 16

philbert440/ThinkingCap-Qwen3.6-27B-Uncensored-Medium-W4A16

Image-Text-to-Text • 7B • Updated 1 day ago • 15

philbert440/Qwen3.6-27B-Uncensored-Medium-W4A16-AWQ

Image-Text-to-Text • 27B • Updated 1 day ago • 17

SAIFIINDUSTRIES/Qwen2.5-VL-72B-Instruct-quantized.w4a16

Image-Text-to-Text • 73B • Updated 2 days ago • 13

NeuralNet-Hub/Qwen3.5-9B-Uncensored-W4A16

Image-Text-to-Text • 9B • Updated about 22 hours ago • 82

belltechsoft/B-Brain-31B-it-mafra-sql-merged-v0.1-w4a16

31B • Updated 1 day ago • 5

LeaderboardModel1/Fara1.5-4B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated 1 day ago • 15

LeaderboardModel1/HARC-Qwen2.5-7B-Instruct-AutoRound-W4A16-RTN

Text Generation • 1B • Updated 1 day ago • 12

LeaderboardModel1/XYZ-Aquila-mini-AutoRound-W4A16-Tuning

Text Generation • 1B • Updated about 9 hours ago • 4