Edit Models filters

Model Tree

HuggingFaceTB/SmolLM-135M-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33

Base only

Active filters: HuggingFaceTB/SmolLM-135M-Instruct

MaziyarPanahi/SmolLM-135M-Instruct-GGUF

Text Generation • 0.1B • Updated Jul 22, 2024 • 761 • 3

mlc-ai/SmolLM-135M-Instruct-q4f32_1-MLC

Updated Sep 7, 2025 • 2 • 1

mlc-ai/SmolLM-135M-Instruct-q4f16_1-MLC

Updated Sep 7, 2025 • 6 • 2

mlc-ai/SmolLM-135M-Instruct-q0f32-MLC

Updated Sep 7, 2025 • 6

mlc-ai/SmolLM-135M-Instruct-q0f16-MLC

Updated Sep 7, 2025 • 1

Felladrin/gguf-SmolLM-135M-Instruct

0.1B • Updated Jul 23, 2024 • 587

mradermacher/SmolLM-135M-Instruct-GGUF

0.1B • Updated Mar 4, 2025 • 564 • 1

second-state/SmolLM-135M-Instruct-GGUF

Text Generation • 0.1B • Updated Jul 29, 2024 • 906

gaianet/SmolLM-135M-Instruct-GGUF

Text Generation • 0.1B • Updated Jul 31, 2024 • 289

jtatman/llama_smollm_135m_skunkworks_reasoning_alpaca_gguf

0.1B • Updated Jul 27, 2024 • 40

mjdousti/SmolLM-135M-Instruct-Q4_K_M-GGUF

0.1B • Updated Aug 12, 2024 • 28

fredderf121/SmolLM-135M-Instruct-Q4_K_M-GGUF

0.1B • Updated Aug 14, 2024 • 15

HuggingFaceTB/smollm-135M-instruct-v0.2-Q8_0-GGUF

0.1B • Updated Aug 18, 2024 • 8.64k • 5

RedHatAI/SmolLM-135M-Instruct-quantized.w8a16

Text Generation • 0.2B • Updated Oct 9, 2024 • 352

RedHatAI/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • 0.2B • Updated Oct 9, 2024 • 26 • 1

madroid/SmolLM-135M-Instruct-4bit

Text Generation • 21M • Updated Aug 27, 2024 • 10

unclemusclez/SmolLM-135M-Instruct-DEVINator-v0.2

Sentence Similarity • 0.1B • Updated Aug 30, 2024 • 130

unclemusclez/SmolLM-135M-Instruct-DEVINator-v0.1

Sentence Similarity • 0.1B • Updated Aug 30, 2024 • 126

Felladrin/gguf-Q8_0-smollm-135M-instruct-v0.2

0.1B • Updated Sep 5, 2024 • 24 • 1

Liquid1/MSU

0.1B • Updated Sep 7, 2024 • 30

unsloth/SmolLM-135M-Instruct-bnb-4bit

Text Generation • 0.1B • Updated Sep 21, 2024 • 569

Segilmez06/SmolLM-135M-Instruct-Q2_K-GGUF

0.1B • Updated Sep 21, 2024 • 10

janspoerer/SmolLM-135M-Instruct-Q2_K-GGUF

0.1B • Updated Sep 23, 2024 • 10

MinKee/SmolLM-135M-Instruct-Q4_K_M-GGUF

0.1B • Updated Sep 26, 2024 • 6

itlwas/SmolLM-135M-Instruct-Q4_K_M-GGUF

0.1B • Updated Dec 29, 2024 • 15

frdrwn/SmolLM-135M-Instruct-Q5_0-GGUF

0.1B • Updated Feb 28, 2025 • 1

mradermacher/SmolLM-135M-Instruct-i1-GGUF

0.1B • Updated Mar 4, 2025 • 37

onnx-community/SmolLM-135M-Instruct-ONNX

Text Generation • Updated Jun 29, 2025 • 71

golangboy/Aicount

Text Generation • 21M • Updated Sep 22, 2025 • 7

amd/SmolLM-135M-Instruct-onnx-ryzenai-1.7-hybrid