ngxson
/

GLM-5-small-test

Model card Files Files and versions

ngxson HF Staff commited on 3 days ago

Commit

dc6b75d

·

verified ·

1 Parent(s): a6a779d

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -12,7 +12,7 @@
     154829
   ],
   "ep_size": 1,
-  "first_k_dense_replace": 1,
   "head_dim": 64,
   "hidden_act": "silu",
   "hidden_size": 512,

     154829
   ],
   "ep_size": 1,
+  "first_k_dense_replace": 3,
   "head_dim": 64,
   "hidden_act": "silu",
   "hidden_size": 512,