MoE models are the new big thing for low-end hardware. Try Chat Completion with the official Gemma 4 samplers: top_k: 64; top_p: 0.95; temp: 1.0
Paul Mercer
unknown2304
P(doom) 10%
AI & ML interests
None yet
Recent Activity
updated a collection about 22 hours ago
26B-A4B RP/eRP and other MoEs liked a model about 23 hours ago
SubMaroon/Kitchoon-V2-26B-A4B updated a collection 20 days ago
26B-A4B RP/eRP and other MoEsOrganizations
None yet
