MultiDiscrete int64/int32 inconsistency

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

Anyone knows what would be the reason why during setup I am getting {'Agent1': array([0, 0, 0, 0, 0], dtype=int64)} 64bit int and on the first step, (when the step is coming from model) I get 32 bit? {'Agent1': array([0, 0, 0, 0, 0], dtype=int32)} The action space is gymnasium.spaces.MultiDiscrete([2, 2, 2, 2, 2]) , which should be 64 bits ints according to the docs.
Is there any flag or setting I can use to enforce model outputing bit format?
I assume the actual reason is perfomance on the model side, but the inconsistency is breaking things.


Hi, could you submit a script to reproduce this bug? If you could open a Github issue, that would be appreciated as well.