meric533 commited on
Commit
745a650
·
verified ·
1 Parent(s): d38a2b0

Fix math numbers (0.468/0.208 vs 0.456/0.212)

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -21,10 +21,12 @@ measure the pedagogy judge's noise floor against training noise.
21
  |---|---|---|
22
  | repo | [`socrateach-sft-olmo2-1b-lora`](https://huggingface.co/meric533/socrateach-sft-olmo2-1b-lora) | `socrateach-sft-olmo2-1b-lora-run2` |
23
  | judge OVERALL (no SI, deduped) | 0.685 | 0.527 |
24
- | GSM8K hinted | 0.556 | 0.552 |
 
25
 
26
- Same data, same hyperparameters, same code. They differ only in run-to-run nondeterminism,
27
- and they are genuinely different weights not a re-upload of one checkpoint.
 
28
 
29
  ## Why this pair matters
30
 
 
21
  |---|---|---|
22
  | repo | [`socrateach-sft-olmo2-1b-lora`](https://huggingface.co/meric533/socrateach-sft-olmo2-1b-lora) | `socrateach-sft-olmo2-1b-lora-run2` |
23
  | judge OVERALL (no SI, deduped) | 0.685 | 0.527 |
24
+ | GSM8K bare | 0.468 | 0.456 |
25
+ | GSM8K hinted | 0.208 | 0.212 |
26
 
27
+ Same recipe, independently trained (run 1 comes from the earlier POC). They are genuinely
28
+ different weights, not a re-upload of one checkpoint. Note how tightly the *math* numbers
29
+ agree — 0.012 and 0.004 apart — compared to the judge gap below.
30
 
31
  ## Why this pair matters
32