Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,006

Base only

Active filters: awq

solidrust/Pantheon-Hermes-rp-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 3

solidrust/Mahou-1.2b-mistral-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 4 • 1

solidrust/llama-3-MagicDolphin-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 3

djuna/Hermes-3-L3.1-lorablated-solidrust

Text Generation • 8B • Updated Sep 3, 2024 • 7

solidrust/Llama-3.1-8B-Lexi-Uncensored-V2-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 685 • 1

solidrust/llama3.1-airoboros3.2-QDT-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 2

solidrust/llama3.1-gutenberg-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 3

solidrust/llama3.1-cc-8B-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 3

solidrust/Crazy-Qwen2-7b-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 2

abdo-Mansour/Meta-Llama-3.1-8B-Instruct-AWQ-4bit

8B • Updated Sep 3, 2024 • 6

magnifi/parser_user_v20a_epoch_7_lr_0p002_awq

4B • Updated Sep 3, 2024 • 3

solidrust/Nexus-IKM-RolePlay-StoryWriter-Hermes-2-Pro-7B-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 3 • 1

nm-testing/deepseekv2-lite-awq

16B • Updated Sep 3, 2024 • 3 • 1

sensorqa/sensist_new_awq

7B • Updated Sep 4, 2024 • 4

Weni/Brain-Llama3.1-1.0.5-SFT-AWQ

71B • Updated Sep 24, 2024 • 8

magnifi/parser_user_v20b_epoch_7_lr_0p002_awq

4B • Updated Sep 5, 2024 • 3

alegchenko/command-r-08-2024-awq-ru-calib

Text Generation • 34B • Updated Sep 5, 2024 • 10 • 1

TensorML/Midnight-Miqu-70B-v1.5-4bit

Updated Sep 5, 2024 • 7

magnifi/parser_user_v20c_epoch_7_lr_0p002_awq

4B • Updated Sep 5, 2024 • 5

anthracite-org/magnum-v2-123b-AWQ-GEMM

123B • Updated Sep 6, 2024 • 4

yeirr/phi3-mini-128k-instruct-awq-g128-4bit

Text Generation • 4B • Updated Sep 7, 2024 • 4

yeirr/llama3-8b-dolphin-v2.9.1-awq-g128-4bit

Text Generation • 8B • Updated Sep 7, 2024 • 7

yeirr/mistral-7b-v03-instruct-awq-g128-4bit

7B • Updated Sep 7, 2024 • 7

cmshin96/MN-12B-Lyra-v3-awq

Text Generation • 12B • Updated Sep 7, 2024 • 6

cmshin96/MN-12B-Lyra-v1-awq

Text Generation • 12B • Updated Sep 7, 2024 • 5

stelterlab/Yi-Coder-9B-Chat-AWQ

Text Generation • 9B • Updated Sep 8, 2024 • 20 • 3

awilliamson/Meta-Llama-3.1-70B-Instruct-AWQ

Text Generation • 71B • Updated Sep 7, 2024 • 6

azyben8/chat

13B • Updated Sep 8, 2024 • 4

inmirror2024/mai-AWQ

71B • Updated Sep 8, 2024 • 4

RecruitmentSmart/title_prediction-8B-AWQ-4bit_v1

8B • Updated Sep 9, 2024 • 3