README: contents, provenance and recorded LIBERO results
Browse files
README.md
ADDED
|
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- robotics
|
| 5 |
+
- vla
|
| 6 |
+
- libero
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# arc-camode-ft
|
| 10 |
+
|
| 11 |
+
Archived **EMA-only** weights for the six camera-mode (`camode`) LIBERO finetunes —
|
| 12 |
+
the geoA and geoB backbones each finetuned under three camera regimes: `random`,
|
| 13 |
+
`side`, `wrist`. Full checkpoint directories (~46 GiB/step, optimizer state
|
| 14 |
+
included) were deleted from the cluster after this upload verified.
|
| 15 |
+
|
| 16 |
+
## What each file is
|
| 17 |
+
|
| 18 |
+
```
|
| 19 |
+
<run_dir>/config.yaml training config
|
| 20 |
+
<run_dir>/dataset_stats.json normalizer stats
|
| 21 |
+
<run_dir>/<ckpt>.ckpt.shards.step000020000/state.pt EMA weights ONLY
|
| 22 |
+
<run_dir>/<ckpt>.ckpt.shards.step000020000/engine_meta.pt
|
| 23 |
+
```
|
| 24 |
+
|
| 25 |
+
`state.pt` holds `{"extra": {"ema": {name -> fp32 CPU tensor}}}`, the payload
|
| 26 |
+
`methods/lafm/vla_flow_ft.py:load_pretrain_trainables()` reads. Load with
|
| 27 |
+
**`model.init_use_ema=true`**. No `"model"` key, no optimizer state — **init / eval
|
| 28 |
+
only, not resumable**. Each `engine_meta.pt` is the original and its
|
| 29 |
+
`ema_fingerprint` matches the archived tensors (rel < 1e-6).
|
| 30 |
+
|
| 31 |
+
## Contents — all at `step000020000`
|
| 32 |
+
|
| 33 |
+
| run dir | arm | camera mode | off-mode | with-R |
|
| 34 |
+
|---|---|---|---|---|
|
| 35 |
+
| `lafm_vla_flow_neo2b_camArft_camAr0816` | A | random | 12.10 | **97.65** |
|
| 36 |
+
| `lafm_vla_flow_neo2b_camAsft_camAs0817` | A | side | not run | **97.50** |
|
| 37 |
+
| `lafm_vla_flow_neo2b_camAwft_camAw0817` | A | wrist | not run | **98.20** |
|
| 38 |
+
| `lafm_vla_flow_neo2b_camBrft_camBr0816` | B | random | 95.75 | **97.75** |
|
| 39 |
+
| `lafm_vla_flow_neo2b_camBsft_camBs0817` | B | side | 95.75 | **98.50** |
|
| 40 |
+
| `lafm_vla_flow_neo2b_camBwft_camBw0817` | B | wrist | 95.60 | **98.35** |
|
| 41 |
+
|
| 42 |
+
Full 4-suite LIBERO (spatial / object / goal / long; 10 tasks x 50 trials x 4 =
|
| 43 |
+
2000 rollouts per cell), **NA12** decode: replan 12, horizon 20, NFE 10,
|
| 44 |
+
control_rate 20, `use_ema: true`, render 256, pinned mujoco 3.2.3 / robosuite 1.4.1.
|
| 45 |
+
Single seed per cell.
|
| 46 |
+
|
| 47 |
+
**Reading the two columns.** "with-R" supplies the camera-mode conditioning at eval;
|
| 48 |
+
"off-mode" withholds it. Arm A collapses without conditioning (12.10) because arm A
|
| 49 |
+
has no text fallback path — that is by design, not a regression. Arm B degrades
|
| 50 |
+
gracefully (~95.6–95.8). Off-mode was never run for camA side/wrist.
|
| 51 |
+
|
| 52 |
+
## Not included
|
| 53 |
+
|
| 54 |
+
Only `step000020000` is archived per run. Steps 2500–17500 were deleted and are
|
| 55 |
+
**not** recoverable. Two extra evaluated points that are now gone:
|
| 56 |
+
camArft @15000 off-mode 14.35, camBrft @15000 off-mode 95.55.
|