---
base_model: zai-org/GLM-4.7-Flash
library_name: peft
tags:
- lora
- grpo
- code
- cpp
---

# Generalized C++ kernel GRPO20

Portable PEFT LoRA checkpoints from `generalized-cpp-kernel-grpo20-spot-20260829-083214-retry1`.

## Selected checkpoint

The selected release checkpoint is `iter_0000014`. Selection basis: higher four-trial Fixed26 Pass@1 and turn-2 means than iter 19.

| Field | Value |
| --- | --- |
| Base model | `zai-org/GLM-4.7-Flash@7dd20894a642a0aa287e9827cb1a1f7f91386b67` |
| Adapter SHA-256 | `b4bb3a250e28696c597d84db459caa75978e160996818dbfce22b8896b2c794b` |
| LoRA rank / alpha | 16 / 32 |
| Target modules | `q_a_proj`, `kv_a_proj_with_mqa`, `o_proj`, `gate_proj`, `up_proj`, `down_proj` |
| Planned updates | 20 |
| Run outcome | Retry completed all 20 updates and preserved checkpoints through iter 19. |
| Training data | `Generalized_CPP_GRPO20_train.jsonl`, 6 rows |
| Training-data SHA-256 | `566ea43aad4f6419b345e0295288c27b374575ce4db30cbd2d6b7510bf86ffbe` |
| Training-manifest SHA-256 | `25d6165985c440e0bc79f3a3f2a6aeeac4943324f2289bc03fd1d775d30bf3a6` |

## Post-training evaluations

Each row uses only its selected best four receipt-verified trials (26 tasks per trial, 104 task evaluations). Iterations are reported separately.

| Checkpoint | Pass@1 trial scores | Pass@1 mean | Turn-2 trial scores | Turn-2 mean |
| --- | --- | ---: | --- | ---: |
| `iter_0000014` | 13, 13, 11, 10 | 11.75/26 | 17, 17, 14, 16 | 16/26 |
| `iter_0000019` | 12, 10, 10, 9 | 10.25/26 | 17, 13, 13, 11 | 13.5/26 |

| Checkpoint | Pass@1 SD; range; task-bootstrap 95% CI (out of 26) | Turn-2 SD; range; task-bootstrap 95% CI (out of 26) | Conditional turn-2 recovery |
| --- | --- | --- | --- |
| `iter_0000014` | 1.50; 10-13; 8-15.5 | 1.41; 14-17; 11.75-20 | 17/57 (29.8%; CI 14.5-48.9%) |
| `iter_0000019` | 1.26; 9-12; 6.25-14.5 | 2.52; 11-17; 9.25-17.75 | 13/63 (20.6%; CI 9.5-35.0%) |

Evaluation used `fixed26-contract-v2`, thinking enabled, temperature 0.7, top-p 1.0, and a 32,768-token response limit. The complete selected run IDs and byte-for-byte receipts are under `evaluations/`.

## Training data

6 executable shadow-task rows: clock, complex-numbers, crypto-square, grade-school, kindergarten-garden, and perfect-numbers. The manifest explicitly records overlap with six Fixed26 task IDs; reference answers are not packaged.

The exact JSONL and its source manifest are included at the repository root. Their hashes are checked during release construction.

## Checkpoints

Every checkpoint directory contains only the two portable inference artifacts: `adapter_config.json` and `adapter_model.bin`. Megatron tensor-parallel shards, optimizer state, and other training-only files are intentionally omitted.

| Checkpoint | Adapter SHA-256 |
| --- | --- |
| `iter_0000004` | `cf25cdb386b4e9cbc372480768882dc9f828b5b68e9017868c0255945d30aec6` |
| `iter_0000009` | `83eec62a120142917902355a641043cf1970658170056b6fce5ebf98dd1de7dd` |
| `iter_0000014` | `b4bb3a250e28696c597d84db459caa75978e160996818dbfce22b8896b2c794b` |
| `iter_0000019` | `e915a82a09a290cd4a6b587fe08fdad8acbbf58dea27e1a53e9e77f9effdf300` |

## Loading

```python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "zai-org/GLM-4.7-Flash"
checkpoint = "Terrano09/generalized-cpp-kernel-GRPO20"
subfolder = "checkpoints/iter_0000014/adapter"

tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(base, trust_remote_code=True)
model = PeftModel.from_pretrained(model, checkpoint, subfolder=subfolder)
```

## Reproduction and evidence

The release includes the exact training JSONL and manifest plus four aggregate receipts and eight shard receipts for each reported evaluation row. Checksum files bind each evidence bundle.

These are assisted Fixed26 regression results using selected best-four cohorts, not pristine held-out benchmark claims. The Generalized C++ dataset, where applicable, explicitly overlaps six Fixed26 task IDs; consult its included manifest before comparing results.