Hi, everybody!
agent.get_weights()
I have got the weights of the policy model. And I want to make a copy_model using the torch.How to get the weight?
mannyv
June 26, 2021, 1:54pm
2
I think this example should have what you are looking for:
# Create a new dummy Trainer to "fix" our checkpoint.
new_trainer = PPOTrainer(config=config)
# Get untrained weights for all policies.
untrained_weights = new_trainer.get_weights()
# Restore all policies from checkpoint.
new_trainer.restore(best_checkpoint)
# Set back all weights (except for 1st agent) to original
# untrained weights.
new_trainer.set_weights(
{pid: w
for pid, w in untrained_weights.items() if pid != "policy_0"})
Hi @mannyv , thanks for your reply.