Hello everyone, I am trying to train a PPO agent with a custom environment, CartPole1-v1. I have created the custom environment, but I am having trouble registering it with Ray RLlib. I have tried multiple approaches, but I keep encountering errors. I would like to train the agent using the rllib t…

I am trying to register and train a custom environment using the rllib train file command and a configuration file. My custom environment, CustomCartPole, wraps the ‘CartPole-v1’ environment from Gym. I have registered the environment with the string name “CartPole1-v1” as shown in the code below: i…

Hi @Hars , it is hard to say what exactly your error is. Using register_env is here the right way to do it. For the records: You do not need to import the register_env from tune.registry directly as it is available from the __init__.py via from ray.tune import register_env The way you registered …

Hi @Lars_Simon_Zehnder , initially your code didn’t work on my system possibly due to installation of ray-rllib with pip instead of conda. After the installation with conda , your program is working properly on my system, but still the actual question remain same as I want to use an external config f…

@Hars , I am also using pip when installing it. How do you install this? Did you follow the documentation ? python -m pip install "ray[tune,rllib]" should do the work. If you want to run RLlib algorithm via a YAML file you need to either Define the environment in a file that can be imported in t…

Dear @Lars_Simon_Zehnder , I initially installed the package by following the documentation. However, it didn’t seem to work, possibly due to the version of Python I was using at the time. Now, I can successfully train my model. The first option you provided worked for me. After carefully reviewing…

Hi @Hars , good to hear that training runs. For evaluation could you try to provide also the environment via the --env option (similar to the --algo option? You can provide here the path to the class.

Hi @Lars_Simon_Zehnder , even when I pass the --env option, I’m still encountering the same error. Can you please provide some guidance on how to resolve this issue? Additionally, I’ve opened a separate topic to discuss this issue in more detail. Any assistance would be greatly appreciated.

Registering Custom Environment for `CartPole-v1` with RLlib and Running via Command Line

RLlib

Lars_Simon_Zehnder April 14, 2023, 8:25am 9

FYI: Changed for evaluation topic to Custom Environment Training Works, But Evaluation Fails

Topic		Replies	Views
Register a custom environment and runing PPOTrainer on that environment not working RLlib	7	2900	September 24, 2023
Custom Environment Training Works, But Evaluation Fails Configure Algorithm, Training, Evaluation, Scaling	7	1089	February 21, 2024
Issue with Running Experiments with Custom Gym Environment RLlib	4	536	June 13, 2022
Custom Gym Environment NaN RLlib	0	301	June 16, 2023
Can I use RLlib with a custom environment without registering it? RLlib	1	587	February 1, 2023

Registering Custom Environment for `CartPole-v1` with RLlib and Running via Command Line

Related topics