How to select variables for optimizerd to exclude CNN from updates?

  • Medium: It contributes to significant difficulty to complete my task, but I can

I am trying to learn to use sac with image input. In this case, we are trying to implement a method in which Critic is updated including the convolutional network, and Actor shares the convolutional network with Critic and excludes the convolutional network from the parameters to be updated.

It seems that the parameters to be updated are determined using the following policy_variable function.

The original network is ComplexInputNetwork, and I think I can exclude the update parameters related to VisionNetwork from it, but I can’t think of a clever way to do it.

Can anyone give me a better way to do this?

Please have a look at the following thread: Partial freeze and partial train

1 Like