Input to TorchModelV2 forward method inconsistent,

[mannyv]

Hello @user777888,

This post may be of some use for you.

[Contribution] [Help needed] Implementing easy action masking for distributional and dueling DQN

How severe does this issue affect your experience of using Ray? None: Just asking a question out of curiosity Hi, I’ve implemented an easy action masking method in compute_q_values for DQN (including dueling and distributional). I made a fork with my commited changes, but I don’t want to have anti-patterns so I’m looking for feedback here. (Am I even in the right place?) For now I have only implemented the changes in torch and it requires having an additional attribute in the DQN model (opti…