Hello, just tested the example at the subject with ray 1.7.0 on torch and tf2 and ray 2.0.0.dev0 on torch and it fails with the following error:
File "/opt/conda/lib/python3.9/site-packages/ray/rllib/env/base_env.py", line 417, in poll
obs[i], rewards[i], dones[i], infos[i] = env_state.poll()
File "/opt/conda/lib/python3.9/site-packages/ray/rllib/env/base_env.py", line 493, in poll
for ag in observations.keys():
AttributeError: 'list' object has no attribute 'keys'
Should I report this error in github issues?