Difference between `.value_function` and `.state_value` in DQN

Hi,

I am confused about the difference between the .value_function and .state_value function calls that can be made from a DQN policy. Don’t both of these reference V(s)?

Thanks,
Sam

State value is used exclusively by DQN based policies. Other more actor critic like policies use value_function.

1 Like