3 Commits

Author	SHA1	Message	Date
Michel Aractingi	18207d995e	- Added additional logging information in wandb around the timings of the policy loop and optimization loop. ... - Optimized critic design that improves the performance of the learner loop by a factor of 2 - Cleaned the code and fixed style issues - Completed the config with actor_learner_config field that contains host-ip and port elemnts that are necessary for the actor-learner servers. Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>	2025-03-28 17:18:24 +00:00
Michel Aractingi	a0a81c0c12	FREEDOM, added back the optimization loop code in learner_server.py ... Ran experiment with pushcube env from maniskill. The learning seem to work. Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>	2025-03-28 17:18:24 +00:00
Michel Aractingi	ef64ba91d9	Added server directory in lerobot/scripts that contains scripts and the protobuf message types to split training into two processes, acting and learning. The actor rollouts the policy and collects interaction data while the learner recieves the data, trains the policy and sends the updated parameters to the actor. The two scripts are ran simultaneously ... Co-authored-by: Adil Zouitine <adilzouitinegm@gmail.com>	2025-03-28 17:18:24 +00:00