[RLlib] Make it easier to play trained policies

[RickLan]

Hi @drozzy I feel your pain. I came from stable_baselines too. I just wrote a runnable script to try out a trained policy below. It’s for multi-agent but can be easily modified for single agent. I think the docs has an example for single agent, but I couldn’t remember where atm. Cheers,

TF error when restoring from checkpoint, multi-agent

import ray import ray.rllib.agents.ppo as ppo from ray.tune.logger import pretty_print from ray.rllib.examples.env.random_env import RandomMultiAgentEnv num_agents = 2 config = ppo.DEFAULT_CONFIG.copy() config["num_workers"] = 1 config["env_config"] = { "num_agents" : num_agents, } env = RandomMultiAgentEnv(config["env_config"]) config["multiagent"] = { "policies" : { # (policy_cls, obs_space, act_space, config) "{}".format(x): (None, env.observation_space, env.action_space, {}) for …

Edit: there is definitely a higher learning curve for RLlib than stable_baselines, imho. For my research work, I wish I had started with RLlib than stable_baselines.

Edit 2: the single agent version is here: Getting Started with RLlib — Ray 3.0.0.dev0