voidstream commited on
Commit
1abecb5
·
verified ·
1 Parent(s): 0636546

Update model card: LoRA fine-tuning now supported via HelixLinearSTE

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -93,7 +93,7 @@ All deltas within noise. Task performance preserved after 3.6x compression.
93
  ## Good to Know
94
 
95
  - **GPU and CPU supported** -- runs on any CUDA GPU or CPU.
96
- - **Not fine-tunable** -- compressed weights are read-only (`is_trainable = False`).
97
  - **Requires `helix-substrate`** -- you need `pip install "helix-substrate[hf]"`.
98
  - **Embeddings stored exact** -- token, position, and patch embeddings are at full precision. Only the 218 attention + MLP linear layers are compressed.
99
 
 
93
  ## Good to Know
94
 
95
  - **GPU and CPU supported** -- runs on any CUDA GPU or CPU.
96
+ - **Fine-tunable via LoRA** compressed weights remain frozen, but LoRA adapters attach to each `HelixLinear` layer via `HelixLinearSTE`. See `helix-substrate` for training infrastructure.
97
  - **Requires `helix-substrate`** -- you need `pip install "helix-substrate[hf]"`.
98
  - **Embeddings stored exact** -- token, position, and patch embeddings are at full precision. Only the 218 attention + MLP linear layers are compressed.
99