fp16 llm - a roshniramesh Collection

roshniramesh 's Collections

nf4 llm

fp8 llm

fp16 llm

updated Jan 16, 2025

nvidia/Hymba-1.5B-Instruct

Text Generation • 2B • Updated Jan 2, 2025 • 271 • 242
OpenVINO/mistral-7b-instruct-v0.1-fp16-ov

Text Generation • Updated Nov 11, 2024 • 11
microsoft/phi-4

Text Generation • 15B • Updated Nov 24, 2025 • 496k • 2.21k
unsloth/phi-4-GGUF

Text Generation • 15B • Updated Jan 13, 2025 • 2.43k • 181
microsoft/phi-4-gguf

Text Generation • 15B • Updated Nov 24, 2025 • 6.64k • 168
microsoft/Phi-3-mini-4k-instruct

Text Generation • 4B • Updated 29 days ago • 1.56M • 1.36k
microsoft/Phi-3.5-mini-instruct

Text Generation • 4B • Updated 29 days ago • 274k • 942
microsoft/phi-1_5

Text Generation • 1B • Updated Nov 24, 2025 • 40.5k • 1.35k
microsoft/phi-1

Text Generation • 1B • Updated Nov 24, 2025 • 3k • 218
microsoft/Phi-3-small-8k-instruct

Text Generation • 7B • Updated 29 days ago • 3.48k • 173
mistralai/Mistral-Nemo-Instruct-2407

12B • Updated Jul 28, 2025 • 47.9k • 1.64k
Qwen/Qwen-14B-Chat

Text Generation • 14B • Updated Dec 13, 2023 • 1.28k • 369
Qwen/Qwen-14B

Text Generation • 14B • Updated Dec 13, 2023 • 3.12k • 211
Qwen/Qwen-14B-Chat-Int4

Text Generation • 14B • Updated Dec 13, 2023 • 84 • 100
Qwen/Qwen-7B

Text Generation • 8B • Updated Jan 4, 2024 • 40.5k • 392
Qwen/Qwen-7B-Chat

Text Generation • 8B • Updated Mar 19, 2024 • 24.8k • 785
Qwen/Qwen-1_8B

Text Generation • 2B • Updated Dec 13, 2023 • 3.04k • 71
Qwen/Qwen-1_8B-Chat

Text Generation • 2B • Updated Dec 13, 2023 • 4.11k • 123
Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • 111B • Updated Apr 30, 2024 • 34 • 9
Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • 7B • Updated Apr 23, 2024 • 572 • 109
Qwen/CodeQwen1.5-7B-Chat

Text Generation • 7B • Updated Apr 30, 2024 • 1.09k • 350
Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • 0.6B • Updated Apr 30, 2024 • 89 • 7
Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • 2B • Updated Apr 30, 2024 • 93 • 4
Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • 14B • Updated Apr 30, 2024 • 390 • 23
Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • 4B • Updated Apr 30, 2024 • 2.8k • 3
Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • 72B • Updated Apr 30, 2024 • 328 • 25
Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • 7B • Updated Apr 30, 2024 • 90 • 14
Qwen/Qwen2.5-7B

Text Generation • 8B • Updated Sep 25, 2024 • 810k • • 252
Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Oct 9, 2024 • 248k • 6
Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 20, 2024 • 57.8k • 67
Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Oct 9, 2024 • 1.46k • 10
Qwen/Qwen2.5-1.5B

Text Generation • 2B • Updated Oct 8, 2024 • 465k • • 154
Qwen/Qwen2.5-0.5B

Text Generation • 0.5B • Updated Sep 25, 2024 • 1.66M • 353
Qwen/Qwen2.5-3B

Text Generation • 3B • Updated Sep 20, 2024 • 263k • 160
Qwen/Qwen1.5-4B

Text Generation • 4B • Updated Apr 5, 2024 • 16.2k • 35
Qwen/Qwen2-0.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Aug 21, 2024 • 274 • 5
Qwen/Qwen2-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Aug 21, 2024 • 7.72k • 9
Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • 8B • Updated Aug 21, 2024 • 1.31k • 22
Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • 73B • Updated Aug 21, 2024 • 311 • 41
Qwen/Qwen2-0.5B

Text Generation • 0.5B • Updated Oct 22, 2024 • 269k • 161
Qwen/Qwen2-1.5B

Text Generation • 2B • Updated Jun 6, 2024 • 190k • • 98
Qwen/Qwen2-7B

Text Generation • 8B • Updated Jun 6, 2024 • 78.9k • • 169
mistralai/Mistral-7B-Instruct-v0.2

Text Generation • 7B • Updated Jul 24, 2025 • 2.29M • • 3.05k