Specify which layers to restore

How to restore only a part of the neural network in rllib? Does “custom_model_config” have a layer wise restore parameter which I can use?

Hi @Shawan_Mohammed,

Welcome to the forum.

This kind of feature is not built into rllib. One option you have is to create your own custom policy and override the set_weights method.

Here is the current set_weights method for torch as an example.