matatonic/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-6.5bpw-h8-exl2 Text Generation • Updated Jan 6, 2025 • 11 • 1
bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Oct 16, 2024 • 2.67k • 106
lmstudio-community/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Oct 15, 2024 • 1.92k • 39
mlx-community/nvidia_Llama-3.1-Nemotron-70B-Instruct-HF_4bit Text Generation • 11B • Updated Oct 16, 2024 • 725 • 12
mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit Text Generation • 20B • Updated Oct 17, 2024 • 178 • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic Text Generation • 71B • Updated Jun 9 • 434 • 15
unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit Text Generation • 73B • Updated Oct 17, 2024 • 227 • 20
DevQuasar-5/nvidia.Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Feb 1, 2025 • 30 • 1
mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-4bit Text Generation • 11B • Updated Oct 17, 2024 • 398 • 2
second-state/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Oct 18, 2024 • 187
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-65536-woft 8B • Updated Feb 25, 2025 • 13 • 1
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v8-k65536-65536-woft 11B • Updated Feb 25, 2025 • 9 • 5
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-16384-woft 7B • Updated Feb 25, 2025 • 8
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-256-woft 6B • Updated Feb 25, 2025 • 12 • 1
ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4 Text Generation • 71B • Updated Dec 7, 2024 • 368 • 6
joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4 Text Generation • 71B • Updated Nov 5, 2024 • 11 • 3
RohitPoreddy/Llama-3.1-Nemotron-70B-Instruct-HF-Q4-mlx Text Generation • 11B • Updated Nov 7, 2024 • 29