I am writing to ask a question about the max_episode_steps attribute.
I have created a custom environment in RLlib. Whenever I start the trainin g of the agent I get bellow warnings. Could you help me how to solve this issue?
It should be noted that I have added max_steps in horizon or soft_horizon of the config dictionary, but it shows these warnings again:
Your env doesn’t have a .spec.max_episode_steps attribute. This is fine if you have set ‘horizon’ in your config dictionary, or
soft_horizon. However, if you haven’t, ‘horizon’ will default to infinity, and your environment will not be reset.
_get_slice_indices has been deprecated. This will raise an error in the future!