Hi @Anas_BELFADIL, can you provide some more information as of how you’re starting the PPO training?
I ask because I’ve been having trouble using these weights inside Tune. Although today I found a solution by mathpluscode that might be the answer to this: It’s the las comment by him
When I start the PPO training, after using set_weights, I just go through a training loop using the trainer I created.