miru-codev3-tokenlearn

Owned Tokenlearn static code embedding bag (256-d, Model2Vec) — branch A of miru-codev3-dual.

Trained with Zipf-SIF Tokenlearn on CornStack coderankembed-v2 features (code_static.train_miru_codev3).

Evaluation

CoIR / MTEB NDCG@10 (×100), dense retrieval only. Scores are self-reported from the training repo eval harness.

Usage

from model2vec import StaticModel

model = StaticModel.from_pretrained("Takara-DS1/miru-codev3-tokenlearn")
emb = model.encode(["def add(a, b): return a + b"])

For the 512-d dual (this bag ⊕ distill_fuse), use Takara-DS1/miru-codev3-dual.

Recreate

See the dual repo reproduce/REPRODUCE.md (step 1: train_miru_codev3).

License

MIT