How to use from
Hermes Agent
Start the llama.cpp server
# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf HauhauCS/GLM-4.7-Flash-Uncensored-HauhauCS-Balanced:
Configure Hermes
# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default HauhauCS/GLM-4.7-Flash-Uncensored-HauhauCS-Balanced:
Run Hermes
hermes
Quick Links

GLM-4.7-Flash-Uncensored-HauhauCS-Balanced

Join the Discord for updates, roadmaps, projects, or just to chat.

GLM-4.7 Flash uncensored by HauhauCS.

About

No changes to datasets or capabilities. Fully functional, 100% of what the original authors intended - just without the refusals.

These are meant to be the best lossless uncensored models out there.

Agentic Coding

If you're doing agentic coding, use the Balanced variants. Good balance between capability and not refusing everything.

Downloads

File Quant Size
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced-FP16.gguf FP16 56 GB
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced-Q8_0.gguf Q8_0 30 GB
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced-Q6_K.gguf Q6_K 23 GB
GLM-4.7-Flash-Uncensored-HauhauCS-Balanced-Q4_K_M.gguf Q4_K_M 17 GB

Specs

Recommended Settings

From the official Z.ai authors:

General use:

  • --temp 1.0 --top-p 0.95

Tool-calling / agentic:

  • --temp 0.7 --top-p 1.0

Important:

  • Disable repeat penalty (or --repeat-penalty 1.0)
  • For llama.cpp: use --min-p 0.01 (default 0.05 is too high)
  • Use --jinja flag for llama.cpp

Note: Not recommended for Ollama due to chat template issues. Works well with llama.cpp, LM Studio, Jan.

Usage

Works with llama.cpp, LM Studio, Jan, koboldcpp, etc.

Downloads last month
4,018
GGUF
Model size
30B params
Architecture
deepseek2
Hardware compatibility
Log In to add your hardware

4-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ 1 Ask for provider support

Spaces using HauhauCS/GLM-4.7-Flash-Uncensored-HauhauCS-Balanced 2