Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25

Base only

Active filters: single-gpu

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated 5 days ago • 65 • 3

bowmanslayer/Qwen3.6-27B-Text-Only-W4A16-g128-ToolCalling

Text Generation • Updated May 22 • 1

bowmanslayer/Qwen3.6-27B-Text-Only-W4A16-g128-MTP-ToolCalling

Text Generation • Updated May 22 • 1

Ddavidich/LOMONOSOV-ZENIT-27B-1M-INDEV

Text Generation • 16B • Updated 3 days ago • 530 • 1

prometheusAIR/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 1 day ago • 13 • 1

Joysulem/FireEcho

Text Generation • Updated Feb 17 • 9

Nekochu/nanochat-d24

Text Generation • 1B • Updated 25 days ago • 337 • 5

AndriejusNak/gemma4-26b-moe-finetune

Text Generation • Updated Apr 17 • 1

AliceYin/l20-edu-135m

Text Generation • 0.1B • Updated Jun 16 • 406 • 2

nazdef/1gpu-llm-small-en-it-base

Text Generation • 0.1B • Updated 16 days ago • 295

LordNeel/Ornith-1.0-35B-GGUF-llamacpp-tp1

Text Generation • 35B • Updated Jun 30 • 12.6k • 10

nazdef/gpt2medium-en-it-nanochat-gpt2preln-lr2e4-bs2-ga48-wsd-anchor20k-final2e5-webwiki-step13500

Text Generation • 0.3B • Updated Jun 28 • 8

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14200

Text Generation • 0.3B • Updated Jun 29 • 5

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14250

Text Generation • 0.3B • Updated Jun 29 • 5

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14500

Text Generation • 0.3B • Updated Jun 29 • 7

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14700

Text Generation • 0.3B • Updated Jun 29 • 6

nazdef/1gpu-llm-medium-en-it-base

Text Generation • 0.3B • Updated 19 days ago • 270

nazdef/gpt2small-en-it-nanochat-gpt2preln-cpt8600-lr5e5-predecay-step18000

Text Generation • 0.1B • Updated 30 days ago • 182

nazdef/1gpu-llm-small-en-it-base-v2

Text Generation • 0.1B • Updated 17 days ago • 561

starvingcheetah/DeepSeek-V4-Flash-custom-iq3down-GGUF

284B • Updated 24 days ago • 320

nazdef/20260703_continual-pretraining-gpt2medium-step34000-nodecay

Text Generation • 0.3B • Updated 18 days ago • 176

nazdef/20260713_resume-gpt2medium-step22000-d1800-step23100

Text Generation • 0.3B • Updated 18 days ago • 185

nazdef/20260713_resume-gpt2medium-step31000-d2000-step33000

Text Generation • 0.3B • Updated 18 days ago • 246

nazdef/1gpu-llm-medium-en-it-base-v2

Text Generation • 0.3B • Updated 17 days ago • 126

rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm

Text Generation • 85B • Updated 5 days ago • 384 • 6