German-Calibrated Quantized Models Collection W4A16 and FP8 quantizations of open models, calibrated on German text with static fp8 KV-cache scales baked in. • 4 items • Updated 27 days ago
SinclairSchneider/Mistral-Medium-3.5-128B-W4A16-KV8 Text Generation • 22B • Updated 27 days ago • 850
SinclairSchneider/Mistral-Medium-3.5-128B-W4A16-KV8 Text Generation • 22B • Updated 27 days ago • 850
German-Calibrated Quantized Models Collection W4A16 and FP8 quantizations of open models, calibrated on German text with static fp8 KV-cache scales baked in. • 4 items • Updated 27 days ago
German-Calibrated Quantized Models Collection W4A16 and FP8 quantizations of open models, calibrated on German text with static fp8 KV-cache scales baked in. • 4 items • Updated 27 days ago
German-Calibrated Quantized Models Collection W4A16 and FP8 quantizations of open models, calibrated on German text with static fp8 KV-cache scales baked in. • 4 items • Updated 27 days ago