Tacoin commited on
Commit
f249652
·
verified ·
1 Parent(s): 78eabf3

Add README

Browse files
Files changed (1) hide show
  1. README.md +72 -0
README.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: nvidia/GR00T-N1.5-3B
4
+ tags:
5
+ - robot-learning
6
+ - gr00t
7
+ - diffusion-policy
8
+ - libero
9
+ - object-centric
10
+ library_name: gr00t
11
+ pipeline_tag: robotics
12
+ inference: false
13
+ ---
14
+
15
+ # Tacoin GR00T Libero Object 8K (Checkpoint 8000)
16
+
17
+ Tacoin fine-tuned GR00T checkpoint trained on the LIBERO libero object 8k benchmark. The policy consumes dual RGB views (`video.image`, `video.wrist_image`) plus an 8-D state and predicts 16 joint-space actions using the diffusion head.
18
+
19
+ ## Training Snapshot
20
+
21
+ - **Base model:** `nvidia/GR00T-N1.5-3B`
22
+ - **Checkpoint step:** 8000 / 8000
23
+ - **Dataset:** libero_object (10 tasks, 454 demos @ 10.0 FPS)
24
+ - **Run notes:** 8k-step continuation fine-tune
25
+
26
+ ## Evaluation
27
+
28
+ Offline reconstruction evaluated on 10 evenly spaced trajectories (160 steps each) with decord backend and `denoising_steps=4`. Metrics are on unnormalized actions.
29
+
30
+ | Metric | Value |
31
+ | --- | --- |
32
+ | Average MSE | **0.03396** |
33
+ | Median MSE | 0.03179 |
34
+ | Std MSE | 0.01547 |
35
+ | Max MSE | 0.06431 |
36
+ | Fraction ≤ 0.05 | 80.0% |
37
+ | Fraction ≤ 0.075 | 100.0% |
38
+ | Fraction ≤ 0.10 | 100.0% |
39
+
40
+ ## Usage
41
+
42
+ ```python
43
+ from gr00t.experiment.data_config import load_data_config
44
+ from gr00t.model.policy import Gr00tPolicy
45
+
46
+ ckpt = 'Tacoin/GR00T-N1.5-3B-LIBERO-OBJECT-8K'
47
+ data_config = load_data_config('libero_gr00t')
48
+ policy = Gr00tPolicy(
49
+ model_path=ckpt,
50
+ modality_config=data_config.modality_config(),
51
+ modality_transform=data_config.transform(),
52
+ embodiment_tag='new_embodiment',
53
+ denoising_steps=4,
54
+ )
55
+ ```
56
+
57
+ Pass a LeRobot observation dict to `policy.get_action(...)` to obtain the 16-step plan.
58
+
59
+ ## Files
60
+
61
+ | Path | Description |
62
+ | --- | --- |
63
+ | `config.json` | Transformer config for the action head. |
64
+ | `model-0000x-of-00002.safetensors` | Sharded weights. |
65
+ | `model.safetensors.index.json` | Weight shard index. |
66
+ | `experiment_cfg/metadata.json` | Dataset statistics for normalization. |
67
+ | `optimizer.pt`, `scheduler.pt`, `rng_state.pth` | Optimizer state for resuming. |
68
+ | `trainer_state.json` | Trainer snapshot (loss curves, etc.). |
69
+
70
+ ## License
71
+
72
+ Apache-2.0. Please credit NVIDIA Isaac GR00T and LIBERO when using this checkpoint.