rajthakkar123
/

Kimi-K2.5-Clean-Skeleton-Uncompressed-TtT

Model card Files Files and versions

rajthakkar123 commited on 10 days ago

Commit

fbe7124

·

verified ·

1 Parent(s): 45c277c

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -53,7 +53,7 @@
   "max_length": 20,
   "max_position_embeddings": 262144,
   "min_length": 0,
-  "moe_intermediate_size": null,
   "moe_layer_freq": 1,
   "n_group": 1,
   "n_routed_experts": 384,

   "max_length": 20,
   "max_position_embeddings": 262144,
   "min_length": 0,
+  "moe_intermediate_size": 2048,
   "moe_layer_freq": 1,
   "n_group": 1,
   "n_routed_experts": 384,