Hello,
I’m looking into trying out an autoregressive action model for one of my projects. I just looked through the example autoregressive model and action distribution..
The custom environment used with the autoregressive example uses an action space of (Discrete(2), Discrete(2))
. The model contains a warning that it is only suitable for binary action spaces. I’m wondering if anyone can offer any insight into how the model/distribution would need to be changed to use higher dimensional discrete spaces, besides the input/output sizes in the model.
I greatly appreciate any advice!