RedHatAI/SmolLM-135M-Instruct-quantized.w8a16
Text Generation • 0.2B • Updated • 461
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 111 • 1
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation • 2B • Updated • 191
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 174
RedHatAI/Qwen2-72B-Instruct-quantized.w8a8
Text Generation • 73B • Updated • 147 • 2
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a8
Text Generation • 2B • Updated • 299
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 217
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation • 8B • Updated • 67
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8
Text Generation • 4B • Updated • 196
RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a16
Text Generation • 4B • Updated • 110
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16
Text Generation • 4B • Updated • 183 • 1
RedHatAI/Phi-3-mini-128k-instruct-FP8
Text Generation • 4B • Updated • 71
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8
Text Generation • 14B • Updated • 105 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16
Text Generation • 14B • Updated • 99 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16
Text Generation • 14B • Updated • 1.25k • 3
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 60 • 5
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16
Text Generation • 12B • Updated • 121
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation • 12B • Updated • 1.6k • 4
RedHatAI/Mistral-Large-Instruct-2407-FP8
Text Generation • 123B • Updated • 194
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8
Text Generation • 7B • Updated • 129 • 2
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation • 8B • Updated • 5.73k • 5
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation • 8B • Updated • 155 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation • 8B • Updated • 11.8k • 20
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation • 8B • Updated • 782 • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 136k • 45
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation • 71B • Updated • 115
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation • 71B • Updated • 105
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 1k • 21
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation • 71B • Updated • 133 • 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 354 • 7