neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation • 4B • Updated • 370
Neural Magic
company
Verified
AI & ML interests
LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV
dsikka
updated a
model about 1 year ago
dsikka
published a
model about 1 year ago
Breaking change in transformers
1
#1 opened over 1 year ago
by 
maldv
nm-research
updated 3
models over 1 year ago
Update preprocessor_config.json
2
#4 opened over 1 year ago
by 
ManishThota
nm-research
updated 5
models over 1 year ago
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 73B • Updated • 263 • 8
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 4.11k • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
Image-Text-to-Text • 4B • Updated • 66.9k • 3
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
Image-Text-to-Text • 4B • Updated • 125k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 396 • 4
shubhrapandit
updated 6
models over 1 year ago
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 124B • Updated • 34
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
Image-Text-to-Text • 124B • Updated • 29
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text • 124B • Updated • 80 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 73B • Updated • 22
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 29
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 30