RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
97
•
2
Granite Quantized
Quantized Granite models from IBM Research.
-
-
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation • 3B • Updated • 5 -
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation • 1B • Updated • 546 • 1 -
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation • 3B • Updated • 55 -
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation • 8B • Updated • 4 -
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation • 0.5B • Updated • 36 -
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation • 1B • Updated • 2 • 1 -
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation • 8B • Updated • 9 • 1 -
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation • 3B • Updated • 9 -
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation • 3B • Updated • 2 -
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation • 0.5B • Updated • 27 -
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation • 8B • Updated • 2