I’m trying to Train and solve (with
CarRacing-v0 problem (https://gym.openai.com/envs/CarRacing-v0/)
agent = PPOTrainer(config=config,env="CarRacing-v0") agent.Train()
It doesn’t work out of the box because I get this error (I understand this is somehow related to the observation space being to big or something like that) (this works with other env like
ValueError: No default configuration for obs shape [96, 96, 3], you must specify conv_filters
manually as a model option. Default configurations are only available for inputs of shape [42, 42, K] and [84, 84, K]. You may alternatively want to use a custom model or preprocessor.
As suggested, I tried to use a preprocessor:
I stumble upon this piece of documentation https://docs.ray.io/en/latest/rllib-models.html#custom-preprocessors-and-environment-filters that tells me that I should use
gym.wrappers to do that
But after searching for a while, I can’t figure out a way, since the
PPOTrainer constructor expect a string (which correspond to one of the open ai gym environnement), not a wrapper
I even tried to register an environment that uses the wrapper but that doesn’t work either (I’m aware that this code makes no sense but I tried anyways).
env=gym.make("CarRacing-v0") register_env("my_env",lambda config: PixelObservationWrapper(env=env))
In that case I get this error:
ray.exceptions.RayActorError: The actor died because of an error raised in its creation task, ray::RolloutWorker.__init__() (pid=32129, ip=192.168.0.32) File "/home/benjamin/.local/lib/python3.9/site-packages/ray/rllib/evaluation/rollout_worker.py", line 456, in __init__ self.env = env_creator(copy.deepcopy(self.env_context)) File "/home/benjamin/git/advancedparallelsystemproject2/train.py", line 24, in <lambda> register_env("my_env",lambda config: PixelObservationWrapper(env=env)) File "/home/benjamin/.local/lib/python3.9/site-packages/gym/wrappers/pixel_observation.py", line 88, in __init__ if np.issubdtype(pixels.dtype, np.integer): AttributeError: 'NoneType' object has no attribute 'dtype'
I cannot find any pointer on how to do this anywhere.
Really stuck here, would appreciate any help.
Alternatively, I could try to do a convolution filter or a custom model but I have no idea on how to do that either. (And to be honest I’m not sure what these mean anyways)
Sorry if I sound like I misunderstand things, that’s because I’m new to this.