FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 42 items • Updated Mar 2 • 80
Skywork/Skywork-Reward-Gemma-2-27B Text Classification • 27B • Updated Oct 25, 2024 • 186 • 49