metadata
base_model:
- moonshotai/Kimi-Linear-48B-A3B-Instruct
Require compiling by yourself
git clone https://github.com/ggml-org/llama.cpp --branch pr-17592
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release