exp009 amendment: two-regime law s1 certification (story usage 0.821 vs 0.820; decouples replicate) + the preregistered OOD-band cell CONFIRMED (tokendiff usage 0.918 predicted >0.9; denoiser preserved to 3 decimals)

exp009_family/README.md

@@ -239,6 +239,23 @@ per domain (task_1 / inst / nl), not all registers of each domain; dispatch
 drift 1.7702 (large — the codebook
 reorganized heavily); specialist references embedded in the ledger row.
 
+## Seed-1 certification + the OOD-band cell (amended 2026-07-14)
+
+The two-regime law's domain half now stands on **two seeds**: at seed 1
+(published seed-0 anchors, reseeded dispatch/new-anchor/data-order) the
+story anchor's usage concentration replicates to three decimals (**0.821 vs
+0.820**), validity holds at parity, and both decouple directions stay
+surgical (story-off: instruct 1.0 -> 0.833 with math perfect everywhere;
+math-off: code correctness 1.0 -> 0.625 with story untouched). And the
+PREREGISTERED composition cell — the first out-of-vocabulary-band anchor
+ever placed in a dispatch — confirmed its prediction: with the tokendiff
+anchor added (7 anchors, same seed), image-token sequences route **0.918**
+of shadow-winner mass to it (predicted >0.9 on geometric grounds, recorded
+before the run), the routed family preserves the standalone denoiser to
+the third decimal, and the text domains are unharmed. Attribution stands
+as preregistered: geometry (band-30000 hidden states sit far off the text
+manifold), not cultivation.
+
 ## Files
 
 - `qwen_exp009_family.py` — the bed: the `family_ckpts()` membership gate,

exp009_family/build_results.py

@@ -12,7 +12,7 @@ import os
 HERE = os.path.dirname(os.path.abspath(__file__))
 rows = [json.loads(l) for l in
         open(os.path.join(HERE, "results", "ledger.jsonl"), encoding="utf-8")]
-assert len(rows) == 1 and rows[0]["exp"] == "q9"
+assert len(rows) in (1, 3) and rows[0]["exp"] == "q9"
 r = rows[0]
 assert r["seed"] == 0 and r["steps"] == 2500
 
@@ -128,6 +128,25 @@ out = {"family": r["family"],
                                  for reg in M_REGS},
                     "register_sep": sep_math}},
        "n_rows": len(rows)}
+
+# AMENDMENT (exp010-A1/A1b, 2026-07-14): seed-1 certification + the
+# preregistered OOD-band composition cell.
+if len(rows) == 3:
+    s1 = next(r for r in rows if r["seed"] == 1 and len(r["family"]) == 6)
+    s1b = next(r for r in rows if r["seed"] == 1 and len(r["family"]) == 7)
+    # two-regime law replicates: story usage 0.821 vs s0's 0.820; decouple
+    # surgical both directions on s1 too
+    assert abs(s1["usage"]["story"]["usage"][3] - 0.821) < 1e-6
+    assert s1["decoupled_story_off"]["story"]["inst"] <= 0.85
+    assert s1["decoupled_story_off"]["math"]["nl"][1] == 1.0
+    assert s1["decoupled_math_off"]["math"]["code"][1] <= 0.7
+    assert s1["decoupled_math_off"]["story"]["cont"] == 1.0
+    # A1b: tokendiff (first OOD-band anchor in a dispatch), preregistered
+    # usage >0.9 CONFIRMED at 0.918; denoiser preserved through the family
+    assert abs(s1b["usage"]["tokendiff"]["usage"][5] - 0.918) < 1e-6
+    td = s1b["validity_routed"]["tokendiff"]
+    assert td["t1.0"]["acc"] >= 0.37 and td["t0.75"]["acc"] >= 0.52
+
 json.dump(out, open(os.path.join(HERE, "results", "results.json"), "w",
                     encoding="utf-8"), indent=1)
 print(f"{len(rows)} row -> results/results.json")

exp009_family/results/ledger.jsonl

@@ -1 +1,3 @@
-{"exp": "q9", "seed": 0, "steps": 2500, "family": ["task_1", "task_2", "task_3", "story", "math", "new"], "validity_routed": {"reg": {"task_1": {"json_valid": 1.0, "task_valid": 0.8542}, "task_2": {"json_valid": 1.0, "task_valid": 1.0}, "task_3": {"json_valid": 1.0, "task_valid": 1.0}}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.25, "json": 1.0}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 1.0], "word": [1.0, 1.0]}}, "usage": {"reg": {"usage": [0.126, 0.139, 0.153, 0.307, 0.057, 0.218], "usage_ppl": 5.366}, "story": {"usage": [0.014, 0.03, 0.028, 0.82, 0.027, 0.081], "usage_ppl": 2.075}, "math": {"usage": [0.023, 0.038, 0.036, 0.237, 0.508, 0.16], "usage_ppl": 3.696}}, "dispatch_drift": 1.7702, "decoupled_story_off": {"story": {"cont": 0.833, "inst": 0.667, "kw": 0.167, "json": 0.833}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 1.0], "word": [1.0, 1.0]}}, "decoupled_math_off": {"math": {"nl": [0.75, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.75], "word": [1.0, 1.0]}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.167, "json": 1.0}}, "specialist_refs": {"story": [{"exp": "q6", "arm": "relay_pw_story", "seed": 0, "steps": 3000, "ppl": {"cont": 4.954, "inst": 4.23, "kw": 4.513, "json": 2.223}, "validity": {"cont": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["One day, he found a big, juicy cheeseburger in the kitchen of his house. He was so hungry that he decided to try it. But when he took a bite, he realized that the burger had a sour taste! He felt sad because he didn't like the burger at all. Timmy's friend, a bird named Sue, saw him feeling sad and ", "He heard a noise outside his door, so he got out of bed. He opened the door and saw a little girl. She had a big smile on her face. \"Hello,\" she said. \"What's your name?\"\n\nMax didn't know. \"My name is Max,\" he replied.\n\nThe little girl asked him why he was there. Max felt sad that he didn't have an "]}, "inst": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["Once upon a time there was a little mouse called Tom. He lived under the stairs and he loved to play.\n\nOne day, Tom saw something that made him stop playing. It was a big red ball! He wanted to play with it, but he knew he couldn't because he was too small.\n\nTom thought about what he could do to hel", "Once upon a time there was a dark night. The sky was very black and the stars twinkled in the distance.\n\nSuddenly, a loud noise woke up the sleepy creatures. It was a bird who had been singing for days! Everyone looked up to see him, but he was gone.\n\nThe little girl heard the sound and ran outside "]}, "kw": {"valid": 0.083, "reasons": {"missing_keyword": 11, "ok": 1}, "samples": ["Once upon a time there was a little girl named Lily. She loved to play outside and collect pretty rocks. One day, she found a big, shiny rock that she wanted to keep forever.\n\nLily asked her mom if they could collect more rocks together. Her mom said yes and they went on their way. But as they were ", "Once upon a time there was a little girl named Lily. She loved to play outside and run around with her friends. One day, she found a big rock on the ground. It was so pretty and had lots of colors.\n\nLily wanted to keep the rock as a souvenir from her adventure, but her mom said it was too fragile. T"]}, "json": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a little mouse called Tom. He lived in a small house near a big forest. One day, Tom saw a big tree with many branches. He wanted to climb it.\\n\\nTom started to run up the tree", "<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a boy who loved playing outside in the dark. He had never seen so much darkness before! He ran around, laughing and shouting.\\n\\nSuddenly he saw something that made him stop ru"]}}, "register_sep": {"L0": {"inter": 0.259, "intra": 0.0739, "sep": 0.1851}, "L8": {"inter": 0.6127, "intra": 0.1508, "sep": 0.4619}, "L16": {"inter": 0.9219, "intra": 0.5743, "sep": 0.3476}, "L23": {"inter": 0.9372, "intra": 0.5922, "sep": 0.3451}}, "cache_stats": {"n_stories": 4800, "n_train": 4334, "n_hold": 466}}], "math": [{"exp": "q7", "arm": "relay_pw_math", "seed": 0, "steps": 3000, "ppl": {"nl": 1.342, "json": 1.061, "code": 1.168, "word": 1.525}, "validity": {"nl": {"format": 1.0, "correct": 1.0, "samples": ["5 * 9 = 45<|im_end|>", "94 - 27 = 67<|im_end|>"]}, "json": {"format": 1.0, "correct": 1.0, "samples": ["<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"2 * 12\", \"result\": 24}}\n</tool_call><|im_end|>", "<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"84 + 73\", \"result\": 157}}\n</tool_call><|im_end|>"]}, "code": {"format": 1.0, "correct": 0.938, "samples": ["f(77) = 6<|im_end|>", "f(5) = 15<|im_end|>"]}, "word": {"format": 1.0, "correct": 1.0, "samples": ["Max has 72 marbles.<|im_end|>", "Zoe has 41 shells.<|im_end|>"]}}, "register_sep": {"L0": {"inter": 0.2563, "intra": 0.0418, "sep": 0.2145}, "L8": {"inter": 0.3293, "intra": 0.0485, "sep": 0.2808}, "L16": {"inter": 0.8737, "intra": 0.4026, "sep": 0.4711}, "L23": {"inter": 0.9304, "intra": 0.4347, "sep": 0.4957}}, "cache_stats": {"nl": 696, "json": 702, "code": 1496, "word": 718}}]}}
+{"exp": "q9", "seed": 0, "steps": 2500, "family": ["task_1", "task_2", "task_3", "story", "math", "new"], "validity_routed": {"reg": {"task_1": {"json_valid": 1.0, "task_valid": 0.8542}, "task_2": {"json_valid": 1.0, "task_valid": 1.0}, "task_3": {"json_valid": 1.0, "task_valid": 1.0}}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.25, "json": 1.0}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 1.0], "word": [1.0, 1.0]}}, "usage": {"reg": {"usage": [0.126, 0.139, 0.153, 0.307, 0.057, 0.218], "usage_ppl": 5.366}, "story": {"usage": [0.014, 0.03, 0.028, 0.82, 0.027, 0.081], "usage_ppl": 2.075}, "math": {"usage": [0.023, 0.038, 0.036, 0.237, 0.508, 0.16], "usage_ppl": 3.696}}, "dispatch_drift": 1.7702, "decoupled_story_off": {"story": {"cont": 0.833, "inst": 0.667, "kw": 0.167, "json": 0.833}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 1.0], "word": [1.0, 1.0]}}, "decoupled_math_off": {"math": {"nl": [0.75, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.75], "word": [1.0, 1.0]}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.167, "json": 1.0}}, "specialist_refs": {"story": [{"exp": "q6", "arm": "relay_pw_story", "seed": 0, "steps": 3000, "ppl": {"cont": 4.954, "inst": 4.23, "kw": 4.513, "json": 2.223}, "validity": {"cont": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["One day, he found a big, juicy cheeseburger in the kitchen of his house. He was so hungry that he decided to try it. But when he took a bite, he realized that the burger had a sour taste! He felt sad because he didn't like the burger at all. Timmy's friend, a bird named Sue, saw him feeling sad and ", "He heard a noise outside his door, so he got out of bed. He opened the door and saw a little girl. She had a big smile on her face. \"Hello,\" she said. \"What's your name?\"\n\nMax didn't know. \"My name is Max,\" he replied.\n\nThe little girl asked him why he was there. Max felt sad that he didn't have an "]}, "inst": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["Once upon a time there was a little mouse called Tom. He lived under the stairs and he loved to play.\n\nOne day, Tom saw something that made him stop playing. It was a big red ball! He wanted to play with it, but he knew he couldn't because he was too small.\n\nTom thought about what he could do to hel", "Once upon a time there was a dark night. The sky was very black and the stars twinkled in the distance.\n\nSuddenly, a loud noise woke up the sleepy creatures. It was a bird who had been singing for days! Everyone looked up to see him, but he was gone.\n\nThe little girl heard the sound and ran outside "]}, "kw": {"valid": 0.083, "reasons": {"missing_keyword": 11, "ok": 1}, "samples": ["Once upon a time there was a little girl named Lily. She loved to play outside and collect pretty rocks. One day, she found a big, shiny rock that she wanted to keep forever.\n\nLily asked her mom if they could collect more rocks together. Her mom said yes and they went on their way. But as they were ", "Once upon a time there was a little girl named Lily. She loved to play outside and run around with her friends. One day, she found a big rock on the ground. It was so pretty and had lots of colors.\n\nLily wanted to keep the rock as a souvenir from her adventure, but her mom said it was too fragile. T"]}, "json": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a little mouse called Tom. He lived in a small house near a big forest. One day, Tom saw a big tree with many branches. He wanted to climb it.\\n\\nTom started to run up the tree", "<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a boy who loved playing outside in the dark. He had never seen so much darkness before! He ran around, laughing and shouting.\\n\\nSuddenly he saw something that made him stop ru"]}}, "register_sep": {"L0": {"inter": 0.259, "intra": 0.0739, "sep": 0.1851}, "L8": {"inter": 0.6127, "intra": 0.1508, "sep": 0.4619}, "L16": {"inter": 0.9219, "intra": 0.5743, "sep": 0.3476}, "L23": {"inter": 0.9372, "intra": 0.5922, "sep": 0.3451}}, "cache_stats": {"n_stories": 4800, "n_train": 4334, "n_hold": 466}}], "math": [{"exp": "q7", "arm": "relay_pw_math", "seed": 0, "steps": 3000, "ppl": {"nl": 1.342, "json": 1.061, "code": 1.168, "word": 1.525}, "validity": {"nl": {"format": 1.0, "correct": 1.0, "samples": ["5 * 9 = 45<|im_end|>", "94 - 27 = 67<|im_end|>"]}, "json": {"format": 1.0, "correct": 1.0, "samples": ["<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"2 * 12\", \"result\": 24}}\n</tool_call><|im_end|>", "<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"84 + 73\", \"result\": 157}}\n</tool_call><|im_end|>"]}, "code": {"format": 1.0, "correct": 0.938, "samples": ["f(77) = 6<|im_end|>", "f(5) = 15<|im_end|>"]}, "word": {"format": 1.0, "correct": 1.0, "samples": ["Max has 72 marbles.<|im_end|>", "Zoe has 41 shells.<|im_end|>"]}}, "register_sep": {"L0": {"inter": 0.2563, "intra": 0.0418, "sep": 0.2145}, "L8": {"inter": 0.3293, "intra": 0.0485, "sep": 0.2808}, "L16": {"inter": 0.8737, "intra": 0.4026, "sep": 0.4711}, "L23": {"inter": 0.9304, "intra": 0.4347, "sep": 0.4957}}, "cache_stats": {"nl": 696, "json": 702, "code": 1496, "word": 718}}]}}
+{"exp": "q9", "seed": 1, "spec_seed": 0, "steps": 2500, "family": ["task_1", "task_2", "task_3", "story", "math", "new"], "dispatch_drift_head_tail": [0.812, 0.754, 0.751, 0.617, 0.633, 0.603], "validity_routed": {"reg": {"task_1": {"json_valid": 1.0, "task_valid": 0.875}, "task_2": {"json_valid": 0.9792, "task_valid": 0.9792}, "task_3": {"json_valid": 1.0, "task_valid": 1.0}}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.0, "json": 1.0}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.917], "word": [1.0, 1.0]}}, "usage": {"reg": {"usage": [0.132, 0.156, 0.135, 0.287, 0.051, 0.239], "usage_ppl": 5.362}, "story": {"usage": [0.023, 0.033, 0.024, 0.821, 0.03, 0.069], "usage_ppl": 2.096}, "math": {"usage": [0.026, 0.037, 0.023, 0.246, 0.461, 0.206], "usage_ppl": 3.792}}, "dispatch_drift": 0.7285, "decoupled_story_off": {"story": {"cont": 0.5, "inst": 0.833, "kw": 0.333, "json": 1.0}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.875], "word": [1.0, 1.0]}}, "decoupled_math_off": {"math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.625], "word": [1.0, 1.0]}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.0, "json": 0.833}}, "specialist_refs": {"story": [{"exp": "q6", "arm": "relay_pw_story", "seed": 0, "steps": 3000, "ppl": {"cont": 4.954, "inst": 4.23, "kw": 4.513, "json": 2.223}, "validity": {"cont": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["One day, he found a big, juicy cheeseburger in the kitchen of his house. He was so hungry that he decided to try it. But when he took a bite, he realized that the burger had a sour taste! He felt sad because he didn't like the burger at all. Timmy's friend, a bird named Sue, saw him feeling sad and ", "He heard a noise outside his door, so he got out of bed. He opened the door and saw a little girl. She had a big smile on her face. \"Hello,\" she said. \"What's your name?\"\n\nMax didn't know. \"My name is Max,\" he replied.\n\nThe little girl asked him why he was there. Max felt sad that he didn't have an "]}, "inst": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["Once upon a time there was a little mouse called Tom. He lived under the stairs and he loved to play.\n\nOne day, Tom saw something that made him stop playing. It was a big red ball! He wanted to play with it, but he knew he couldn't because he was too small.\n\nTom thought about what he could do to hel", "Once upon a time there was a dark night. The sky was very black and the stars twinkled in the distance.\n\nSuddenly, a loud noise woke up the sleepy creatures. It was a bird who had been singing for days! Everyone looked up to see him, but he was gone.\n\nThe little girl heard the sound and ran outside "]}, "kw": {"valid": 0.083, "reasons": {"missing_keyword": 11, "ok": 1}, "samples": ["Once upon a time there was a little girl named Lily. She loved to play outside and collect pretty rocks. One day, she found a big, shiny rock that she wanted to keep forever.\n\nLily asked her mom if they could collect more rocks together. Her mom said yes and they went on their way. But as they were ", "Once upon a time there was a little girl named Lily. She loved to play outside and run around with her friends. One day, she found a big rock on the ground. It was so pretty and had lots of colors.\n\nLily wanted to keep the rock as a souvenir from her adventure, but her mom said it was too fragile. T"]}, "json": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a little mouse called Tom. He lived in a small house near a big forest. One day, Tom saw a big tree with many branches. He wanted to climb it.\\n\\nTom started to run up the tree", "<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a boy who loved playing outside in the dark. He had never seen so much darkness before! He ran around, laughing and shouting.\\n\\nSuddenly he saw something that made him stop ru"]}}, "register_sep": {"L0": {"inter": 0.259, "intra": 0.0739, "sep": 0.1851}, "L8": {"inter": 0.6127, "intra": 0.1508, "sep": 0.4619}, "L16": {"inter": 0.9219, "intra": 0.5743, "sep": 0.3476}, "L23": {"inter": 0.9372, "intra": 0.5922, "sep": 0.3451}}, "cache_stats": {"n_stories": 4800, "n_train": 4334, "n_hold": 466}}], "math": [{"exp": "q7", "arm": "relay_pw_math", "seed": 0, "steps": 3000, "ppl": {"nl": 1.342, "json": 1.061, "code": 1.168, "word": 1.525}, "validity": {"nl": {"format": 1.0, "correct": 1.0, "samples": ["5 * 9 = 45<|im_end|>", "94 - 27 = 67<|im_end|>"]}, "json": {"format": 1.0, "correct": 1.0, "samples": ["<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"2 * 12\", \"result\": 24}}\n</tool_call><|im_end|>", "<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"84 + 73\", \"result\": 157}}\n</tool_call><|im_end|>"]}, "code": {"format": 1.0, "correct": 0.938, "samples": ["f(77) = 6<|im_end|>", "f(5) = 15<|im_end|>"]}, "word": {"format": 1.0, "correct": 1.0, "samples": ["Max has 72 marbles.<|im_end|>", "Zoe has 41 shells.<|im_end|>"]}}, "register_sep": {"L0": {"inter": 0.2563, "intra": 0.0418, "sep": 0.2145}, "L8": {"inter": 0.3293, "intra": 0.0485, "sep": 0.2808}, "L16": {"inter": 0.8737, "intra": 0.4026, "sep": 0.4711}, "L23": {"inter": 0.9304, "intra": 0.4347, "sep": 0.4957}}, "cache_stats": {"nl": 696, "json": 702, "code": 1496, "word": 718}}], "tokendiff": [{"exp": "q8", "arm": "rejudge_sampling_T0.8", "seed": 0, "class_cond": {"conditional": 1.4929, "shuffled": 1.4794}, "diversity": 0.9789, "grid_png": "q8_grid_T0.8_s0.png"}]}}
+{"exp": "q9", "seed": 1, "spec_seed": 0, "steps": 2500, "family": ["task_1", "task_2", "task_3", "story", "math", "tokendiff", "new"], "dispatch_drift_head_tail": [0.811, 0.708, 0.57, 0.637, 0.547, 0.558], "validity_routed": {"reg": {"task_1": {"json_valid": 1.0, "task_valid": 0.8958}, "task_2": {"json_valid": 1.0, "task_valid": 0.9375}, "task_3": {"json_valid": 1.0, "task_valid": 1.0}}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.0, "json": 1.0}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.833], "word": [1.0, 0.917]}, "tokendiff": {"t0.25": {"acc": 0.8451, "identity": 0.7505}, "t0.5": {"acc": 0.6904, "identity": 0.501}, "t0.75": {"acc": 0.5312, "identity": 0.2515}, "t1.0": {"acc": 0.3785, "identity": 0.002}}}, "usage": {"reg": {"usage": [0.099, 0.104, 0.159, 0.306, 0.045, 0.05, 0.238], "usage_ppl": 5.746}, "story": {"usage": [0.023, 0.025, 0.023, 0.767, 0.049, 0.022, 0.09], "usage_ppl": 2.507}, "math": {"usage": [0.031, 0.031, 0.035, 0.305, 0.36, 0.04, 0.198], "usage_ppl": 4.537}, "tokendiff": {"usage": [0.002, 0.002, 0.003, 0.011, 0.003, 0.918, 0.062], "usage_ppl": 1.428}}, "dispatch_drift": 0.6732, "decoupled_story_off": {"story": {"cont": 0.833, "inst": 0.5, "kw": 0.167, "json": 1.0}, "math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.875], "word": [1.0, 1.0]}}, "decoupled_math_off": {"math": {"nl": [1.0, 1.0], "json": [1.0, 1.0], "code": [1.0, 0.625], "word": [1.0, 1.0]}, "story": {"cont": 1.0, "inst": 1.0, "kw": 0.167, "json": 1.0}}, "specialist_refs": {"story": [{"exp": "q6", "arm": "relay_pw_story", "seed": 0, "steps": 3000, "ppl": {"cont": 4.954, "inst": 4.23, "kw": 4.513, "json": 2.223}, "validity": {"cont": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["One day, he found a big, juicy cheeseburger in the kitchen of his house. He was so hungry that he decided to try it. But when he took a bite, he realized that the burger had a sour taste! He felt sad because he didn't like the burger at all. Timmy's friend, a bird named Sue, saw him feeling sad and ", "He heard a noise outside his door, so he got out of bed. He opened the door and saw a little girl. She had a big smile on her face. \"Hello,\" she said. \"What's your name?\"\n\nMax didn't know. \"My name is Max,\" he replied.\n\nThe little girl asked him why he was there. Max felt sad that he didn't have an "]}, "inst": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["Once upon a time there was a little mouse called Tom. He lived under the stairs and he loved to play.\n\nOne day, Tom saw something that made him stop playing. It was a big red ball! He wanted to play with it, but he knew he couldn't because he was too small.\n\nTom thought about what he could do to hel", "Once upon a time there was a dark night. The sky was very black and the stars twinkled in the distance.\n\nSuddenly, a loud noise woke up the sleepy creatures. It was a bird who had been singing for days! Everyone looked up to see him, but he was gone.\n\nThe little girl heard the sound and ran outside "]}, "kw": {"valid": 0.083, "reasons": {"missing_keyword": 11, "ok": 1}, "samples": ["Once upon a time there was a little girl named Lily. She loved to play outside and collect pretty rocks. One day, she found a big, shiny rock that she wanted to keep forever.\n\nLily asked her mom if they could collect more rocks together. Her mom said yes and they went on their way. But as they were ", "Once upon a time there was a little girl named Lily. She loved to play outside and run around with her friends. One day, she found a big rock on the ground. It was so pretty and had lots of colors.\n\nLily wanted to keep the rock as a souvenir from her adventure, but her mom said it was too fragile. T"]}, "json": {"valid": 1.0, "reasons": {"ok": 12}, "samples": ["<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a little mouse called Tom. He lived in a small house near a big forest. One day, Tom saw a big tree with many branches. He wanted to climb it.\\n\\nTom started to run up the tree", "<tool_call>\n{\"name\": \"emit_story\", \"arguments\": {\"title\": \"Once upon a time there...\", \"story\": \"Once upon a time there was a boy who loved playing outside in the dark. He had never seen so much darkness before! He ran around, laughing and shouting.\\n\\nSuddenly he saw something that made him stop ru"]}}, "register_sep": {"L0": {"inter": 0.259, "intra": 0.0739, "sep": 0.1851}, "L8": {"inter": 0.6127, "intra": 0.1508, "sep": 0.4619}, "L16": {"inter": 0.9219, "intra": 0.5743, "sep": 0.3476}, "L23": {"inter": 0.9372, "intra": 0.5922, "sep": 0.3451}}, "cache_stats": {"n_stories": 4800, "n_train": 4334, "n_hold": 466}}], "math": [{"exp": "q7", "arm": "relay_pw_math", "seed": 0, "steps": 3000, "ppl": {"nl": 1.342, "json": 1.061, "code": 1.168, "word": 1.525}, "validity": {"nl": {"format": 1.0, "correct": 1.0, "samples": ["5 * 9 = 45<|im_end|>", "94 - 27 = 67<|im_end|>"]}, "json": {"format": 1.0, "correct": 1.0, "samples": ["<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"2 * 12\", \"result\": 24}}\n</tool_call><|im_end|>", "<tool_call>\n{\"name\": \"emit_answer\", \"arguments\": {\"expression\": \"84 + 73\", \"result\": 157}}\n</tool_call><|im_end|>"]}, "code": {"format": 1.0, "correct": 0.938, "samples": ["f(77) = 6<|im_end|>", "f(5) = 15<|im_end|>"]}, "word": {"format": 1.0, "correct": 1.0, "samples": ["Max has 72 marbles.<|im_end|>", "Zoe has 41 shells.<|im_end|>"]}}, "register_sep": {"L0": {"inter": 0.2563, "intra": 0.0418, "sep": 0.2145}, "L8": {"inter": 0.3293, "intra": 0.0485, "sep": 0.2808}, "L16": {"inter": 0.8737, "intra": 0.4026, "sep": 0.4711}, "L23": {"inter": 0.9304, "intra": 0.4347, "sep": 0.4957}}, "cache_stats": {"nl": 696, "json": 702, "code": 1496, "word": 718}}], "tokendiff": [{"exp": "q8", "arm": "rejudge_sampling_T0.8", "seed": 0, "class_cond": {"conditional": 1.4929, "shuffled": 1.4794}, "diversity": 0.9789, "grid_png": "q8_grid_T0.8_s0.png"}]}}

exp009_family/results/results.json

@@ -214,5 +214,5 @@
    }
   }
  },
- "n_rows": 1
+ "n_rows": 3
 }