Hello all! I am attempting to use an RLlib MultiAgentEnv-based environment outside of RLlib for prototyping before I work in RLlib, and I was wondering if it was possible to vectorize environments similar to Gymnasium’s VectorEnv? Although MultiAgentEnv is based on Gym Env, VectorEnv doesn’t support it due to the dictionary-based action space. Does RLlib something have something similar that does support the dictionary action spaces?
The closest thing I could find was this in the GitHub: https://github.com/ray-project/ray/blob/master/rllib/env/vector_env.py However I’m not quite sure how to use it as there are no examples.