Hi, I have created my own environment which is actually a simple tictactoe game. To enable the agent to know which actions are wrong I created my custom model with an action mask in the forward function, but now I don’t manage to run SAC on this environment. How can I do to fix the error?
You will have to describe the error first. The is done easiest with a reproduction script.