[rllib]Help!How can cartpole_client.py and cartpole_server.py use tune to set up distributed enviroment?

TheBloodthirster · December 13, 2020, 8:49am

I use this code
to set up my own gym environment, and then run this code on the server

Could any one please tell me how to add tune in these code to run distributed enviroment?

I see here it seen like can run any number of clients, but how to use tune to select parameters or this mode can’t run with tune ?

Try it yourself by launching either a simple CartPole server (see below), and connecting it to any number of clients (cartpole_client.py)

I search for ray-project/ray/blob/master/rllib/examples/custom_train_fn.py and ray-project/ray/tree/master/rllib/tuned_examples

But have no idea how to use tune in client and server mode?

Could any one help me?

TheBloodthirster · December 13, 2020, 9:19am

github.com

ray-project/ray/blob/master/rllib/examples/custom_train_fn.py#L31


agent1 = PPOTrainer(env="CartPole-v0", config=config)
for _ in range(10):
    result = agent1.train()
    result["phase"] = 1
    reporter(**result)
    phase1_time = result["timesteps_total"]
state = agent1.save()
agent1.stop()
# Train for 100 iterations with low LR
config["lr"] = 0.0001
agent2 = PPOTrainer(env="CartPole-v0", config=config)
agent2.restore(state)
for _ in range(10):
    result = agent2.train()
    result["phase"] = 2
    result["timesteps_total"] += phase1_time  # keep time moving forward
    reporter(**result)
agent2.stop()

I find a example code and can anyone please told me can this work?

take the main code in cartpole_server.py to replace my_train_fn function and then run tune.run?

Topic		Replies	Views
Client-Server and Tune RLlib	3	934	June 29, 2022
Registering Custom Environment for `CartPole-v1` with RLlib and Running via Command Line RLlib	8	1094	April 14, 2023
[Tune/Rllib] Implementing reset_config for Rllib	1	315	March 31, 2024
Issue with Running Experiments with Custom Gym Environment RLlib	4	378	June 13, 2022
Running a random policy with RLlib RLlib	1	729	February 25, 2022

[rllib]Help!How can cartpole_client.py and cartpole_server.py use tune to set up distributed enviroment?

Related Topics