Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,006

Base only

Active filters: awq

magnifi/parser_user_v22b_epoch_7_lr_0p002_awq

4B • Updated Sep 18, 2024 • 6

solidrust/Replete-Reflection-llama-3.1-8b-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 4

solidrust/LLama-3.1-8B-TitanFusion-v2-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 5

solidrust/Apollo-2.0-Llama-3.1-8B-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 4

solidrust/Gemma2-9B-TitanFusion-v2-AWQ

Text Generation • 10B • Updated Sep 19, 2024 • 2 • 1

solidrust/Qwen2-7B-TitanFusion-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 3

solidrust/Vapor_7B-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 6

solidrust/Gemma2-9B-TitanFusion-AWQ

Text Generation • 10B • Updated Sep 19, 2024 • 2

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 3 • 1

solidrust/Llama-3.1-8B-TitanFusion-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 4

solidrust/Magic_8B-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 3

vasileion/Xwin-MLewd-13B-v0.2-AWQ

Text Generation • 13B • Updated Oct 10, 2024

magnifi/parser_user_v22e_epoch_7_lr_0p002_awq

4B • Updated Sep 19, 2024 • 6

magnifi/parser_user_v22f_epoch_7_lr_0p002_awq

4B • Updated Sep 19, 2024 • 4

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • 8B • Updated Nov 18, 2024 • 516k • 26

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Nov 18, 2024 • 3.51k • 4

Orion-zhen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • 8B • Updated Oct 9, 2024 • 604k • 1

solidrust/Smoke_7B-AWQ

Text Generation • 8B • Updated Sep 20, 2024 • 4

solidrust/gemma-2-9b-it-SimPO-AWQ

Text Generation • 10B • Updated Sep 20, 2024 • 3 • 1

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • 10B • Updated Sep 20, 2024 • 3 • 1

solidrust/gemma-2-9b-it-abliterated-AWQ

Text Generation • 10B • Updated Sep 20, 2024 • 168

solidrust/Llama-3SOME-8B-v2-AWQ

Text Generation • 8B • Updated Sep 20, 2024 • 4

magnifi/parser_user_v22g_epoch_7_lr_0p002_awq

4B • Updated Sep 20, 2024 • 2

ywhwang/llama-3.1-Korean-Bllossom-Vision-8B-awq

8B • Updated Sep 21, 2024

ywhwang/llama-3-Korean-Bllossom-8B-awq

8B • Updated Feb 19, 2025

seyoungsong/Qwen2-7B-HanjaMT-AJD-KLC-AWQ

8B • Updated Oct 1, 2024 • 8

solidrust/Magic_v2_8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 5

solidrust/L3-Luna-8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 7

solidrust/Chili_Dog_8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 4

solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 8