Commit Graph

  • 9f437d86b6 fix(groot): align GR00TN15Config with transformers config dataclasses (#3606) Haoming Song 2026-05-22 16:31:04 +08:00
  • b74a551d38 fix(pi0, pi05): stabilize torch.compile and expand test coverage (#3610) Haoming Song 2026-05-22 16:29:34 +08:00
  • a94d9f119c fix(info): fixing info metadata update when is_depth_map was set CarolinePascal 2026-05-22 02:48:30 +02:00
  • 8a615070e7 fix(pre-commit): fixing mutable defautl value CarolinePascal 2026-05-22 02:07:33 +02:00
  • 8e56797287 feat(refactor): refactor DepthEncoderConfig quantization pipeline, so that the methods do not live in the config class. Add pixel format - channels validation.Move the default pixel format for depth in the config file. CarolinePascal 2026-05-22 02:06:37 +02:00
  • 7498f1cf61 feat(pix_fmt channels): use PyAv to check get pixel formats number of channels CarolinePascal 2026-05-22 02:01:05 +02:00
  • c0a2e9814d fix examples (#3623) Nikodem Bartnik 2026-05-21 22:14:07 +02:00
  • 72a429764a tests(depth): adding new tests for depth integration validation CarolinePascal 2026-05-21 20:20:40 +02:00
  • 4ea8653ca3 test(fix): fixing exisiting tests to still work with latest features CarolinePascal 2026-05-21 19:56:00 +02:00
  • eeabb4d258 chore(typos): fixing typos CarolinePascal 2026-05-21 16:11:22 +02:00
  • e050d0fe0a fix(recipes): use active_at for memory_update, rebalance subtask_mem pepijn 2026-05-21 14:53:13 +00:00
  • 2b8d7b3c06 fix(plumbing): fixing missing parts in the depth maps pipeline CarolinePascal 2026-05-21 16:11:01 +02:00
  • 2ca030fa28 fix(pi052): build processors from current config pepijn 2026-05-21 13:54:29 +00:00
  • 4a49f4a391 fix(stop_event): fixing stop_event race condition in camera classes CarolinePascal 2026-05-21 15:51:12 +02:00
  • 36f828221c fix(pi05): preserve pretrained paligemma lm head pepijn 2026-05-21 13:25:03 +00:00
  • d41d874581 fix(pi052): debug parity harness truncates prompt instead of masking Pepijn 2026-05-21 15:09:36 +02:00
  • bac4f61eae refactor: support custom progress parquet overlays (#3640) Khalil Meftah 2026-05-21 14:32:10 +02:00
  • 15647f50a2 feat(is_depth): simplifying is_depth nested name + legacy support CarolinePascal 2026-05-21 14:26:16 +02:00
  • e87933302d feat(depth shape): ensuring depth maps shape is always including the channel CarolinePascal 2026-05-21 14:25:42 +02:00
  • efa05f0ada fix(train): unwrap DDP policy in debug_text_predictions hook Pepijn 2026-05-21 13:41:20 +02:00
  • e98b6f726b feat(train): debug dump runs inference too, with parity check Pepijn 2026-05-21 12:27:32 +02:00
  • f7747d02a9 feat(train): periodic LM-head prediction dump for live debugging Pepijn 2026-05-21 12:23:05 +02:00
  • 86ecd4bc2e add subtask memory training recipe pepijn 2026-05-21 09:56:10 +00:00
  • 28b86449a2 fix(pi05): cast attention masks to model dtype pepijn 2026-05-21 09:51:12 +00:00
  • f4b834844e Feat/clean can bus (#3526) Virgileboat 2026-05-21 11:44:04 +02:00
  • 5cfca59ec7 fix(rewards/topreward): add missing input keys mm_token_type_ids Khalil Meftah 2026-05-21 11:05:02 +02:00
  • 5bb2da4da6 fix(pi052): VQA target format = "label <loc><loc>" not "<loc><loc> label" Pepijn 2026-05-20 18:56:48 +02:00
  • f7b989ad97 fix(pi052): read backbone dtype from q_proj, not first parameter Pepijn 2026-05-20 18:46:08 +02:00
  • 3b4376aa33 fix(pi052): cast attention bias to model dtype for bf16 inference Pepijn 2026-05-20 18:42:26 +02:00
  • f6ecb7b955 refactor(rewards): clean up TOPReward processor/model Khalil Meftah 2026-05-20 17:39:21 +02:00
  • 840dae3277 feat(robots): add MIT-mode option to reBot B601-DM follower rebot-mit-mode Pepijn 2026-05-20 17:22:56 +02:00
  • 3cf5e3c8cb chore(format): format code CarolinePascal 2026-05-20 16:47:22 +02:00
  • 33a3b5a982 feat(depth maps writer): adding support for raw depth maps recording with image writer CarolinePascal 2026-05-20 16:42:16 +02:00
  • 1dafb4acf6 feat(viz): render depth observations as rr.DepthImage in Viridis CarolinePascal 2026-05-20 16:22:34 +02:00
  • 14df709201 feat(record): plumb DepthEncoderConfig through lerobot-record CarolinePascal 2026-05-20 16:14:14 +02:00
  • d6f97ae17f feat(robots/so_follower): emit + populate depth keys when use_depth CarolinePascal 2026-05-20 16:09:53 +02:00
  • 085f574301 feat(features): route 2D camera shapes to observation.depth.<key> CarolinePascal 2026-05-20 15:50:46 +02:00
  • f15348e769 feat(cameras/realsense): expose async depth in metric meters CarolinePascal 2026-05-20 15:24:47 +02:00
  • 99c0d93b34 add more base models to generate model card docs/model-card-improvements Nikodem Bartnik 2026-05-20 12:24:32 +02:00
  • a0233f53f4 feat(annotate): default VLM to Qwen3.6-35B-A3B-FP8 Pepijn 2026-05-20 11:46:59 +02:00
  • 34269a5d78 fix(pi052): register PaliGemma <loc> tokens so they tokenize as single ids Pepijn 2026-05-20 11:41:41 +02:00
  • c62784e14c add port and fix formatting Nikodem Bartnik 2026-05-20 10:56:59 +02:00
  • cc6a2cac43 update policy deployment instruction with rollout Nikodem Bartnik 2026-05-20 10:55:18 +02:00
  • e51d45dd2c feat(depth): wire DatasetReader to decode_depth_frames CarolinePascal 2026-05-19 23:46:28 +02:00
  • d39698da0f feat(depth): wire StreamingVideoEncoder + writer to depth encoder CarolinePascal 2026-05-19 23:23:27 +02:00
  • 75507491bf fix(pi052): VQA <loc> conversion treats coords as 0-1000 normalized Pepijn 2026-05-19 23:21:28 +02:00
  • 88519cb14c fix(pi052): quantile-normalize actions before FAST tokenizer fit Pepijn 2026-05-19 23:02:20 +02:00
  • bc0c993b25 fix(pi052): FAST tokenizer fit read actions from column, not ds[i] Pepijn 2026-05-19 22:51:53 +02:00
  • b4c31f0f67 feat(depth): plumb DepthEncoderConfig through LeRobotDataset and DatasetWriter CarolinePascal 2026-05-19 22:50:19 +02:00
  • ddf4bc2063 fix(pi052): knowledge insulation crashed on wrong _gated_residual import Pepijn 2026-05-19 22:48:02 +02:00
  • b7317b6c29 test(pi052): round-trip coverage for VQA <loc> conversion Pepijn 2026-05-19 22:24:24 +02:00
  • c026aed8f8 feat(pi052): train VQA spatial answers in PaliGemma <loc> format Pepijn 2026-05-19 20:23:46 +02:00
  • 70ad322676 feat(rewards): add TOPReward reward model Khalil Meftah 2026-05-19 18:00:18 +02:00
  • e425dfd624 fix(processor): fallback to task message when recipe misses pepijn 2026-05-19 15:31:24 +00:00
  • 15f79b5e5e fix(pi052): supervise an EOS token at the end of each text target Pepijn 2026-05-19 17:22:22 +02:00
  • 0cc5162078 feat(depth): extend quantization tools to better fit the encoding/decoding pipeline CarolinePascal 2026-05-19 17:10:47 +02:00
  • dfdc48a7f1 fix(datasets): bound VideoDecoderCache to prevent OOM on large datasets (#3614) Roham Z. Nobari 2026-05-19 16:54:25 +02:00
  • 6a8878a639 fix(datasets): normalize shape=(1,) numeric values before HF encoding (#3344) 四七 2026-05-19 22:53:19 +08:00
  • b960524d93 feat(depth): persist depth metadata CarolinePascal 2026-05-19 16:11:21 +02:00
  • 088352383d feat(video): add ffv1 to supported codecs CarolinePascal 2026-05-19 15:48:27 +02:00
  • d38eb89f71 feat(video re-encoding): Adding utility and dataset edition tool for video re-encoding (#3611) Caroline Pascal 2026-05-19 14:46:14 +02:00
  • 7ab4936b1b Add extensive language support (#3467) Pepijn 2026-05-19 14:46:11 +02:00
  • 2ea0da2d9f fix(annotate): tag uploaded dataset revision pepijn 2026-05-19 12:44:35 +00:00
  • 725ac95b0d feat(runtime): make the interactive runtime drive PI052 too Pepijn 2026-05-19 14:28:55 +02:00
  • 7b64e5498d revert(annotate): move memory + speech prompts to base PR (#3471) Pepijn 2026-05-19 14:17:52 +02:00
  • 134a707c7a feat(annotate): first-person memory narrative + shorter speech prompts Pepijn 2026-05-19 14:17:30 +02:00
  • 182f10184f revert(annotate): move pipeline changes to base PR (#3471) Pepijn 2026-05-19 14:07:23 +02:00
  • ca8c60a0ed Set OpenCV fourcc after size and fps (#3620) von Neumann 101 2026-05-19 20:06:41 +08:00
  • ce47075d6b feat(annotate): deterministic plan, single-frame VQA, dataset tagging Pepijn 2026-05-19 14:06:15 +02:00
  • 26013da699 feat(annotations): enforce imperative verb-first subtask phrasing Pepijn 2026-05-19 13:52:54 +02:00
  • bb31988915 fix(pi052): pass 4d masks to prefix-only forwards pepijn 2026-05-18 21:07:13 +00:00
  • 2629175d2d fix(pi05): use fused AdamW by default pepijn 2026-05-18 19:23:17 +00:00
  • 2b4c5f49e3 fix(pi05): disable foreach AdamW by default pepijn 2026-05-18 18:58:17 +00:00
  • 22c9c4905e fix(pi052): avoid dense CE over padded tokens pepijn 2026-05-18 18:40:34 +00:00
  • 7960cc14ec fix(pi052): call policy preprocessing helpers pepijn 2026-05-18 17:52:47 +00:00
  • 3c15fd8537 feat(robots): natively integrate Seeed Studio reBot B601-DM arm (#3624) Pepijn 2026-05-18 19:49:21 +02:00
  • 1750a87104 fix(pi052): handle batched rendered messages pepijn 2026-05-18 17:41:58 +00:00
  • 0e2dc1b76f fix(pi052): supervise only FAST action-code tokens pepijn 2026-05-18 17:38:34 +00:00
  • 42214d1c7a feat(depth): add depth quantization helpers and tests CarolinePascal 2026-04-26 00:02:13 +02:00
  • 474c5478d9 tune(annotations): VQA emission anchors a single frame (K 3 -> 1) Pepijn 2026-05-18 17:24:36 +02:00
  • f72b28738a fix(annotate): default keyframe decode to ffmpeg CLI (thread-safe) Pepijn 2026-05-18 16:40:29 +02:00
  • 1bd53cc7da fix(annotate): decode keyframes via ffmpeg CLI fallback Pepijn 2026-05-18 16:08:31 +02:00
  • 0f5f0e4091 refactor(recipes): rename recipes, drop pi05_hirobot Pepijn 2026-05-18 16:02:15 +02:00
  • 7128bb1769 fix(annotate): decode keyframes via PyAV directly Pepijn 2026-05-18 15:45:04 +02:00
  • 426d48dbbf fix(pi052): port the smolvla2 text-head fixes to pi052 Pepijn 2026-05-18 15:42:19 +02:00
  • fbcb9225f5 feat: oversample sparse VQA annotations (recipe consumption + weighted sampler) Pepijn 2026-05-18 15:30:00 +02:00
  • 31e0c15e55 fix(annotate): pyav fallback when torchcodec keyframe decode fails Pepijn 2026-05-18 15:23:53 +02:00
  • c5676ef1b3 feat(annotate): add dest_repo_id for separate push target Pepijn 2026-05-18 15:05:23 +02:00
  • 5ebbdf3d05 Mention the new Lance LeRobotDataset implementation in the docs (#3609) Quentin Lhoest 2026-05-18 14:51:26 +02:00
  • b319ccf688 fix(smolvla2): only prompt for a camera when a VQA overlay is drawn Pepijn 2026-05-18 14:50:19 +02:00
  • 3174e14bc0 fix(smolvla2): feed all cameras to VQA generation, not just the chosen one Pepijn 2026-05-18 14:46:38 +02:00
  • dc530e10fe feat(smolvla2): VQA example prompts in the panel; drop quotes from hints Pepijn 2026-05-18 14:42:32 +02:00
  • e7c5613a39 refactor(smolvla2): command-driven runtime — no startup prompts Pepijn 2026-05-18 14:37:51 +02:00
  • 516ffc7687 feat(smolvla2): --mode flag, skip task picker with --task, timed /action Pepijn 2026-05-18 14:26:12 +02:00
  • 7a68bf13d9 feat(recipes): add hirobot_memory — hirobot + memory + spoken tool-call replies Pepijn 2026-05-18 14:21:41 +02:00
  • 15229468d0 feat(smolvla2): startup mode prompt; rename /vlm mode to /question Pepijn 2026-05-18 14:17:03 +02:00
  • a9cea3e8dd fix(smolvla2): make the autonomous REPL usable for slash commands / VQA Pepijn 2026-05-18 14:10:13 +02:00
  • 89d4846590 fix(smolvla2): always show the startup task picker on a TTY Pepijn 2026-05-18 14:04:53 +02:00
  • 9dfc9084e1 review: decode keyframes via video_utils.decode_video_frames Pepijn Kooijmans 2026-05-18 14:00:38 +02:00
  • 6e035fb169 Update reward config and model card template (#3625) Khalil Meftah 2026-05-18 13:12:15 +02:00