Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

133

Base only

Active filters: rk3588

3ib0n/Qwen2.5-14B-Instruct-rkllm

Text Generation • Updated Jan 23, 2025 • 2

3ib0n/Qwen2.5-14B-Coder-Instruct-rkllm

Text Generation • Updated Jan 23, 2025

3ib0n/Qwen2.5-7B-Math-Instruct-rkllm

Text Generation • Updated Jan 23, 2025

3ib0n/Qwen2.5-7B-Instruct-rkllm

Text Generation • Updated Jan 23, 2025 • 1

3ib0n/Qwen2.5-7B-Coder-Instruct-rkllm

Text Generation • Updated Jan 24, 2025 • 1

3ib0n/Qwen2.5-3B-Instruct-rkllm

Text Generation • Updated Jan 24, 2025

3ib0n/Qwen2.5-3B-Coder-Instruct-rkllm

Text Generation • Updated Jan 24, 2025 • 1

3ib0n/Qwen2.5-1.5B-Math-Instruct-rkllm

Text Generation • Updated Jan 24, 2025

mshr-h/llm-jp-3-rk3588-1.1.4

Updated Feb 28, 2025

Pelochus/deepseek-R1-distill-qwen-1.5B

Updated May 28, 2025 • 105

Prince-1/SmolVLM-Instruct-GGUF-RKllm

Image-Text-to-Text • Updated Jun 17, 2025 • 2

Prince-1/Veena-RKllm

Text-to-Speech • Updated Jun 26, 2025 • 9 • 1

Prince-1/Mellum-RKllm

Updated Jun 28, 2025 • 3

Prince-1/DeepHermes-3-RKllm

Updated Jun 28, 2025 • 3 • 1

Prince-1/Osmosis-Structure-0.6-RKllm

Updated Jun 28, 2025 • 2

Prince-1/Osmosis-Mcp-Rkllm

Updated Jun 28, 2025 • 3

Prince-1/Gabliterated-Qwen3-RKllm

Updated Jun 28, 2025 • 9

Prince-1/TinyLlama-1.1B-Chat-v1.0-RKLLM

Updated Jun 30, 2025 • 8 • 1

Prince-1/medgemma-4b-pt

Image-Text-to-Text • Updated Jul 4, 2025 • 1

Prince-1/Chatglm3-6b

Updated Jul 4, 2025 • 11

Prince-1/Qwen3-1.7B-RKllm

Updated Jul 4, 2025 • 10 • 1

Prince-1/Gemma-3-12b-pt-RKLlm

Updated Jul 4, 2025 • 5 • 1

Prince-1/Seed-Coder-8B-Instruct-RKllm

Text Generation • Updated Jul 4, 2025 • 2

Prince-1/Llama-OuteTTS-1.0-1B-RKllm

Text-to-Speech • Updated Jul 4, 2025 • 8 • 1

jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 39

jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 4

jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 27, 2025 • 25 • 1

jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 32

jamescallander/MediPhi-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 8 • 1

jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 124 • 2