RWKV-GGUF - a RachidAR Collection

RachidAR 's Collections

Gemma 4 QAT MTP

Fine-Tuned or Trained models

Ternary LLMs & Knowledge distillation & SOTA

SOTA architecture

RWKV-GGUF

updated Oct 7, 2024

RachidAR/RWKV-v6-Finch-1B6-HF-Q5_K_M-GGUF

2B • Updated Sep 4, 2024 • 8 • 2

Note Works with CUDA and CPU backend
RachidAR/RWKV-v6-Finch-14B-HF-Q5_K_M-GGUF

14B • Updated Sep 4, 2024 • 9 • 1

Note Works only with "--no-warmup" parameter.
RachidAR/RWKV-v6-Finch-7B-HF-Q5_K_M-GGUF

8B • Updated Sep 4, 2024 • 5 • 1

Note Works only with "--no-warmup" parameter.