I asked this question on Ray’s Slack channel and now I am transcribing the Thread here so it’s available to everyone. Thanks to @sven1977 and @rliaw for answering my question. Bruno Brandao: Does anyone know how can I pre-train a model with Behaviour Cloning and then load it into PPO for further …

Hi @Ryan_Spangler , could you be a little more specific about what exactly you do not get to work? There is an example here about how to use a pretrained Policy to copy weights over. This is exactly how you would do this after you trained your Policy with BC and want to start PPO with these parameter…

How to pretrain a model with behavior cloning

RLlib

Finebouche December 5, 2023, 3:28pm 16

HI @Ryan_Spangler , did you managed to make it work using @Lars_Simon_Zehnder example ? I am struggling to recover weight

Topic		Replies	Views
Loading pre-trained single-agent policy weights for multi-agent training RLlib	2	717	June 11, 2021
Correct approach to improve/retrain an offiline model RLlib	0	628	December 3, 2020
Transfer Learning for Multi-Agent env. with RLlib RLlib	4	651	September 21, 2022
What information is used for Behaviour cloning RLlib	1	436	January 19, 2023
How do I copy the model? RLlib	2	397	June 28, 2021

How to pretrain a model with behavior cloning

Related Topics