Michel Aractingi
aebea08a99
Added support for checkpointing the policy. We can save and load the policy state dict, optimizers state, optimization step and interaction step
...
Added functions for converting the replay buffer from and to LeRobotDataset. When we want to save the replay buffer, we convert it first to LeRobotDataset format and save it locally and vice-versa.
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com >
2025-04-18 15:04:13 +02:00
Michel Aractingi
03616db82c
Removed unnecessary time.sleep in the streaming server on the learner side
...
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com >
2025-04-18 15:04:13 +02:00
Michel Aractingi
8cd44ae163
- Added additional logging information in wandb around the timings of the policy loop and optimization loop.
...
- Optimized critic design that improves the performance of the learner loop by a factor of 2
- Cleaned the code and fixed style issues
- Completed the config with actor_learner_config field that contains host-ip and port elemnts that are necessary for the actor-learner servers.
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com >
2025-04-18 15:04:13 +02:00
Michel Aractingi
2ae657f568
FREEDOM, added back the optimization loop code in learner_server.py
...
Ran experiment with pushcube env from maniskill. The learning seem to work.
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com >
2025-04-18 15:04:13 +02:00
Michel Aractingi
508f5d1407
Added server directory in lerobot/scripts that contains scripts and the protobuf message types to split training into two processes, acting and learning. The actor rollouts the policy and collects interaction data while the learner recieves the data, trains the policy and sends the updated parameters to the actor. The two scripts are ran simultaneously
...
Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com >
2025-04-18 15:04:13 +02:00
AdilZouitine
c8b1132846
Stable version of rlpd + drq
2025-04-18 15:04:10 +02:00
Adil Zouitine
760d60ad4b
Change SAC policy implementation with configuration and modeling classes
2025-04-18 15:03:51 +02:00
Adil Zouitine
875c0271b7
SAC works
2025-04-18 15:03:51 +02:00
Adil Zouitine
46827fb002
Add rlpd tricks
2025-04-18 15:03:51 +02:00
Adil Zouitine
2fd78879f6
SAC works
2025-04-18 15:03:51 +02:00
Adil Zouitine
a0e2be8b92
[WIP] correct sac implementation
2025-04-18 15:03:51 +02:00
Michel Aractingi
181727c0fe
Extend reward classifier for multiple camera views ( #626 )
2025-04-18 15:03:50 +02:00
Eugene Mironov
d1d6ffd23c
[Port HIL_SERL] Final fixes for the Reward Classifier ( #598 )
2025-04-18 15:03:01 +02:00
Michel Aractingi
4624a836e5
Added normalization schemes and style checks
2025-04-18 15:03:01 +02:00
Michel Aractingi
d1f76cba8e
Update lerobot/scripts/train_hilserl_classifier.py
...
Co-authored-by: Yoel <yoel.chornton@gmail.com >
2025-04-18 15:02:13 +02:00
Eugene Mironov
d78cef1fee
Fixup
2025-04-18 15:02:13 +02:00
Michel Aractingi
30a808c0ae
Add human intervention mechanism and eval_robot script to evaluate policy on the robot ( #541 )
...
Co-authored-by: Yoel <yoel.chornton@gmail.com >
2025-04-18 15:02:13 +02:00
Yoel
4a7f85a6ec
Reward classifier and training ( #528 )
...
Co-authored-by: Daniel Ritchie <daniel@brainwavecollective.ai >
Co-authored-by: resolver101757 <kelster101757@hotmail.com >
Co-authored-by: Jannik Grothusen <56967823+J4nn1K@users.noreply.github.com >
Co-authored-by: Remi <re.cadene@gmail.com >
Co-authored-by: Michel Aractingi <michel.aractingi@huggingface.co >
2025-04-18 15:02:13 +02:00
Junshan Huang
a8db91c40e
Fix Windows HTML visualization to make videos could be seen ( #647 )
...
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com >
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-04-17 15:07:28 +02:00
Steven Palma
4041f57943
feat(visualization): replace cv2 GUI with Rerun (and solves ffmpeg versioning issues) ( #903 )
2025-04-09 17:33:01 +02:00
mshukor
1c873df5c0
Support for PI0+FAST ( #921 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Dana Aubakirova <118912928+danaaubakirova@users.noreply.github.com >
Co-authored-by: Remi <re.cadene@gmail.com >
Co-authored-by: Steven Palma <imstevenpmwork@ieee.org >
2025-04-04 11:51:11 +02:00
Steven Palma
a6015a55f9
chore(scripts): remove deprecated script ( #887 )
2025-03-23 01:16:50 +01:00
Ermano Arruda
c37b1d45b6
parametrise tolerance_s in visualize_dataset scripts ( #716 )
2025-03-13 10:28:29 +01:00
Steven Palma
5e9473806c
refactor(config): Move device & amp args to PreTrainedConfig ( #812 )
...
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com >
2025-03-06 17:59:28 +01:00
Harsimrat Sandhawalia
10706ed753
Support for discrete actions ( #810 )
2025-03-06 10:27:29 +01:00
Steven Palma
5d24ce3160
chore(doc): add license header to all files ( #818 )
2025-03-05 17:56:51 +01:00
Mishig
a27411022d
[visualization] Ignore 2d or 3d data for now ( #809 )
2025-03-04 10:53:01 +01:00
Simon Alibert
8861546ad8
[Security] Add Bandit ( #795 )
2025-03-01 19:19:26 +01:00
Mishig
800c4a847f
[Vizualisation] independent column names ( #783 )
2025-02-27 14:47:18 +01:00
Simon Alibert
a1809ad3de
Add typos checks ( #770 )
2025-02-25 23:51:15 +01:00
Jannik Grothusen
8699a28be0
[QOL] Enable teleoperation during environment reset ( #725 )
2025-02-25 19:28:26 +01:00
Simon Alibert
3354d919fc
LeRobotDataset v2.1 ( #711 )
...
Co-authored-by: Remi <remi.cadene@huggingface.co >
Co-authored-by: Remi Cadene <re.cadene@gmail.com >
2025-02-25 15:27:29 +01:00
Pepijn
aca464ca72
Add mobile so100 ( #724 )
2025-02-25 09:06:50 +01:00
Simon Alibert
c4c2ce04e7
Update pre-commits ( #733 )
2025-02-15 15:51:17 +01:00
Simon Alibert
b86a2c0b47
Fix wandb logging ( #730 )
2025-02-14 18:00:12 +01:00
Ilia Larchenko
c574eb4984
Fixed eval.py on MPS ( #702 )
2025-02-14 00:03:55 +01:00
Simon Alibert
e71095960f
Fixes following #670 ( #719 )
2025-02-12 12:53:55 +01:00
Simon Alibert
90e099b39f
Remove offline training, refactor train.py and logging/checkpointing ( #670 )
...
Co-authored-by: Remi <remi.cadene@huggingface.co >
2025-02-11 10:36:06 +01:00
Remi
638d411cd3
Add Pi0 ( #681 )
...
Co-authored-by: Simon Alibert <simon.alibert@huggingface.co >
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com >
Co-authored-by: Pablo <pablo.montalvo.leroux@gmail.com >
2025-02-04 18:01:04 +01:00
Pepijn
ae9605f03c
fix setting motor id with new dataclass config ( #668 )
2025-01-31 20:48:46 +01:00
Simon Alibert
3c0a209f9f
Simplify configs ( #550 )
...
Co-authored-by: Remi <remi.cadene@huggingface.co >
Co-authored-by: HUANG TZU-CHUN <137322177+tc-huang@users.noreply.github.com >
2025-01-31 13:57:37 +01:00
Morgan Redfield
4323bdce22
updating config instructions for koch 1v1 motors ( #658 )
2025-01-28 13:20:33 +01:00
HUANG TZU-CHUN
5daa45436d
Fix typos in lerobot/scripts/visualize_dataset.py ( #656 )
2025-01-28 13:07:10 +01:00
Pradeep Kadubandi
380b836eee
Fix for the issue https://github.com/huggingface/lerobot/issues/638 ( #639 )
2025-01-15 10:50:38 +01:00
Mishig
25a8597680
[viz] Fixes & updates to html visualizer ( #617 )
2025-01-09 11:39:54 +01:00
Ville Kuosmanen
5097cd900e
fix(visualise): use correct language description for each episode id ( #604 )
...
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com >
2025-01-09 09:39:48 +01:00
Mishig
73b64c3089
[vizualizer] for LeRobodDataset V2 ( #576 )
2024-12-20 16:26:23 +01:00
Simon Alibert
4c41f6fcc6
Fix example 6 ( #572 )
2024-12-11 10:32:18 +01:00
Michel Aractingi
8e7d6970ea
Control simulated robot with real leader ( #514 )
...
Co-authored-by: Remi <remi.cadene@huggingface.co >
2024-12-03 12:20:05 +01:00
Remi
286bca37cc
Fix missing local_files_only in record/replay ( #540 )
...
Co-authored-by: Simon Alibert <alibert.sim@gmail.com >
2024-12-03 10:53:21 +01:00