ReactiveAI
/

RxT-Beta-Decoder-SMAT

Text Generation

model_hub_mixin

pytorch_model_hub_mixin

🇪🇺 Region: EU

Model card Files Files and versions

AdamF92 commited on 5 days ago

Commit

b57921b

·

verified ·

1 Parent(s): ebd4b7b

Epoch 0 - Val loss 2.7051

Files changed (2) hide show

config.json +1 -1
model.safetensors +1 -1

config.json CHANGED Viewed

@@ -32,7 +32,7 @@
     "dense",
     "moe"
   ],
-  "stm_size": 8192,
   "use_attention_output_bias": false,
   "use_flash_attention": true,
   "use_gated": true,

     "dense",
     "moe"
   ],
+  "stm_size": 4096,
   "use_attention_output_bias": false,
   "use_flash_attention": true,
   "use_gated": true,

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:296a67ae93a695ad157bb8f368098e767d6207714e85b5fc8e97af64b246d62b
 size 5772284720

 version https://git-lfs.github.com/spec/v1
+oid sha256:19f8b2fc6a119d88f66105aef446190a7d78f254f43b683733801ac13503b7f1
 size 5772284720