GLM-5-MLX-4.8bit / generation_config.json
abhilashms's picture
Duplicate from inferencerlabs/GLM-5-MLX-4.8bit
3c28641
{
"_from_model_config": true,
"eos_token_id": [
154820,
154827,
154829
],
"pad_token_id": 154820,
"temperature": 1.0,
"top_p": 0.95,
"transformers_version": "5.0.2.dev0"
}