Rendering Gymnasium environments in Ray

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

Hi, I am trying to render gymnasium environments in RLlib, but am running into some problems. I have already installed gymnasium 0.29.1 and am using ray 2.7.0. I am trying to render FrozenLake-v1. I have set render_env = True in the configuration. When I try to run my train script, i get an error:

WARNING env_runner_v2.py:297 -- Could not import gymnasium.envs.classic_control.rendering! Try `pip install gymnasium[all]`.

The classic_control.rendering file is missing from my virtual environment. Ray recommends using gymnasium.wrappers.RecordVideo, but this seems to record and save videos instead of rendering. Can gymnasium 0.29.1 environments be rendered using Ray 2.7?