I’m very new to Ray RLlib and have an issue with using a custom simulator my team made. We’re trying to integrate a custom Python-based simulator into Ray RLlib to do a single-agent DQN training. However, I’m uncertain about how to integrate the simulator into RLlib as an environment.
According to the image below from Ray documentation, it seems like I have two different options:
Standard environment : according to the Carla simulator example, it seems like I can just simply use the
gym.Envclass API to wrap my custom simulator and register as an environment using
External environment : however, the image below and RLlib documentation gave me more confusion since it’s suggesting that external simulators that can run independently outside the control of RLlib should be used via the
If anyone can suggest what I should do, it will be very much appreciated! Thanks!