John Leimgruber III's picture

John Leimgruber III PRO

ubergarm

·

https://blog.aifoundry.org/p/adventures-in-model-quantization

AI & ML interests

Open LLMs and Astrophotography image processing.

Recent Activity

new activity about 10 hours ago

ubergarm/Qwen3.5-122B-A10B-GGUF:How to split this model between 2 (3) GPUs and CPU/RAM ?

new activity about 11 hours ago

ubergarm/Qwen3.5-122B-A10B-GGUF:Testing IQ4_KSS

updated a model about 11 hours ago

ubergarm/Qwen3.5-122B-A10B-GGUF

View all activity

Organizations

ubergarm 's models 41

ubergarm/Qwen3.5-122B-A10B-GGUF

Text Generation • 122B • Updated about 11 hours ago • 8.79k • 10

ubergarm/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated 4 days ago • 7.78k • 5

ubergarm/Qwen3.5-397B-A17B-GGUF

Text Generation • 396B • Updated 15 days ago • 14k • 30

ubergarm/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated 21 days ago • 2.12k • 7

ubergarm/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated 22 days ago • 6.47k • 15

ubergarm/Step-3.5-Flash-GGUF

Text Generation • 197B • Updated Feb 16 • 2.99k • 39

ubergarm/MiniMax-M2.5-GGUF

Text Generation • 229B • Updated Feb 15 • 19.3k • 51

ubergarm/GLM-5-GGUF

Text Generation • 754B • Updated Feb 15 • 724 • 16

ubergarm/Kimi-K2.5-GGUF

Text Generation • 1T • Updated Feb 6 • 308 • 10

ubergarm/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 21 • 748 • 22

ubergarm/DeepSeek-V3.2-Speciale-GGUF

Text Generation • 671B • Updated Jan 9 • 478 • 17

ubergarm/MiMo-V2-Flash-GGUF

Text Generation • 309B • Updated Jan 6 • 50 • 2

ubergarm/Devstral-Small-2-24B-Instruct-2512-GGUF

Text Generation • 24B • Updated Dec 25, 2025 • 145

ubergarm/GLM-4.7-GGUF

Text Generation • 358B • Updated Dec 24, 2025 • 297 • 24

ubergarm/Devstral-2-123B-Instruct-2512-GGUF

Text Generation • Updated Dec 10, 2025 • 175 • 6

ubergarm/GigaChat3-10B-A1.8B-GGUF

Text Generation • Updated Nov 21, 2025 • 309 • 12

ubergarm/Kimi-K2-Thinking-GGUF

Text Generation • Updated Nov 20, 2025 • 261 • 21

ubergarm/Ling-1T-GGUF

Text Generation • Updated Oct 29, 2025 • 175 • 11

ubergarm/GLM-4.6-GGUF

Text Generation • 357B • Updated Oct 2, 2025 • 209 • 28

ubergarm/DeepSeek-V3.1-Terminus-GGUF

Text Generation • Updated Sep 26, 2025 • 241 • 8

ubergarm/Kimi-K2-Instruct-0905-GGUF

Text Generation • Updated Sep 8, 2025 • 193 • 15

ubergarm/GLM-4.5-GGUF

Text Generation • Updated Aug 28, 2025 • 152 • 20

ubergarm/Qwen3-Coder-30B-A3B-Instruct-GGUF

Text Generation • Updated Aug 28, 2025 • 352 • 10

ubergarm/Qwen3-Coder-480B-A35B-Instruct-GGUF

Text Generation • Updated Aug 28, 2025 • 198 • 15

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • Updated Aug 24, 2025 • 233 • 14

ubergarm/GLM-4.5-Air-GGUF

Text Generation • Updated Aug 8, 2025 • 311 • 32

ubergarm/Qwen3-30B-A3B-Thinking-2507-GGUF

Text Generation • Updated Jul 30, 2025 • 294 • 10

ubergarm/Qwen3-30B-A3B-Instruct-2507-GGUF

Text Generation • Updated Jul 30, 2025 • 1.13k • 14

ubergarm/Qwen3-235B-A22B-Thinking-2507-GGUF

Text Generation • Updated Jul 27, 2025 • 116 • 9

ubergarm/Qwen3-235B-A22B-Instruct-2507-GGUF

Text Generation • Updated Jul 27, 2025 • 408 • 16