Add README
Browse files
README.md
ADDED
|
@@ -0,0 +1,72 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: nvidia/GR00T-N1.5-3B
|
| 4 |
+
tags:
|
| 5 |
+
- robot-learning
|
| 6 |
+
- gr00t
|
| 7 |
+
- diffusion-policy
|
| 8 |
+
- libero
|
| 9 |
+
- object-centric
|
| 10 |
+
library_name: gr00t
|
| 11 |
+
pipeline_tag: robotics
|
| 12 |
+
inference: false
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Tacoin GR00T Libero Object 8K (Checkpoint 8000)
|
| 16 |
+
|
| 17 |
+
Tacoin fine-tuned GR00T checkpoint trained on the LIBERO libero object 8k benchmark. The policy consumes dual RGB views (`video.image`, `video.wrist_image`) plus an 8-D state and predicts 16 joint-space actions using the diffusion head.
|
| 18 |
+
|
| 19 |
+
## Training Snapshot
|
| 20 |
+
|
| 21 |
+
- **Base model:** `nvidia/GR00T-N1.5-3B`
|
| 22 |
+
- **Checkpoint step:** 8000 / 8000
|
| 23 |
+
- **Dataset:** libero_object (10 tasks, 454 demos @ 10.0 FPS)
|
| 24 |
+
- **Run notes:** 8k-step continuation fine-tune
|
| 25 |
+
|
| 26 |
+
## Evaluation
|
| 27 |
+
|
| 28 |
+
Offline reconstruction evaluated on 10 evenly spaced trajectories (160 steps each) with decord backend and `denoising_steps=4`. Metrics are on unnormalized actions.
|
| 29 |
+
|
| 30 |
+
| Metric | Value |
|
| 31 |
+
| --- | --- |
|
| 32 |
+
| Average MSE | **0.03396** |
|
| 33 |
+
| Median MSE | 0.03179 |
|
| 34 |
+
| Std MSE | 0.01547 |
|
| 35 |
+
| Max MSE | 0.06431 |
|
| 36 |
+
| Fraction ≤ 0.05 | 80.0% |
|
| 37 |
+
| Fraction ≤ 0.075 | 100.0% |
|
| 38 |
+
| Fraction ≤ 0.10 | 100.0% |
|
| 39 |
+
|
| 40 |
+
## Usage
|
| 41 |
+
|
| 42 |
+
```python
|
| 43 |
+
from gr00t.experiment.data_config import load_data_config
|
| 44 |
+
from gr00t.model.policy import Gr00tPolicy
|
| 45 |
+
|
| 46 |
+
ckpt = 'Tacoin/GR00T-N1.5-3B-LIBERO-OBJECT-8K'
|
| 47 |
+
data_config = load_data_config('libero_gr00t')
|
| 48 |
+
policy = Gr00tPolicy(
|
| 49 |
+
model_path=ckpt,
|
| 50 |
+
modality_config=data_config.modality_config(),
|
| 51 |
+
modality_transform=data_config.transform(),
|
| 52 |
+
embodiment_tag='new_embodiment',
|
| 53 |
+
denoising_steps=4,
|
| 54 |
+
)
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
Pass a LeRobot observation dict to `policy.get_action(...)` to obtain the 16-step plan.
|
| 58 |
+
|
| 59 |
+
## Files
|
| 60 |
+
|
| 61 |
+
| Path | Description |
|
| 62 |
+
| --- | --- |
|
| 63 |
+
| `config.json` | Transformer config for the action head. |
|
| 64 |
+
| `model-0000x-of-00002.safetensors` | Sharded weights. |
|
| 65 |
+
| `model.safetensors.index.json` | Weight shard index. |
|
| 66 |
+
| `experiment_cfg/metadata.json` | Dataset statistics for normalization. |
|
| 67 |
+
| `optimizer.pt`, `scheduler.pt`, `rng_state.pth` | Optimizer state for resuming. |
|
| 68 |
+
| `trainer_state.json` | Trainer snapshot (loss curves, etc.). |
|
| 69 |
+
|
| 70 |
+
## License
|
| 71 |
+
|
| 72 |
+
Apache-2.0. Please credit NVIDIA Isaac GR00T and LIBERO when using this checkpoint.
|