I have an error on Windows when using PPO with Pytorch:
...\envs\rllib-pt\lib\site-packages\ray\rllib\policy\torch_policy.py", line 155, in __init__ (pid=18860) self.device = self.devices (pid=18860) IndexError: list index out of range
I ensured that
torch.cuda.is_available() returns True. The error is due to
ray.get_gpu_ids that returns an empty list, even when
num_gpus was set in
ray.init. It is interesting that
ray.resource_spec._autodetect_num_gpus() returns 1 so we can imagine a fix with this but maybe there is another solution. I am using ray==1.4.