How to restore only a part of the neural network in rllib? Does “custom_model_config” have a layer wise restore parameter which I can use?
Welcome to the forum.
This kind of feature is not built into rllib. One option you have is to create your own custom policy and override the set_weights method.
Here is the current set_weights method for torch as an example.