llama_model_load: error loading model: error loading model hyperparameters: key not found in model: glm-dsa.attention.indexer.head_count

#3
by wpfnnnns - opened

Assuming you're on this PR - https://github.com/ggml-org/llama.cpp/pull/19460
You need the newer (3-4 hrs ago) ggufs. Q2_K_XL works for me

Unsloth AI org

Oh yes please install the pull request which supports GLM-5 - see https://unsloth.ai/docs/models/glm-5

Sign up or log in to comment