Is there any way that all GPUs can be visible by each ray actor or worker?
Because the current solution on a two GPU machine, such as
@ray.remote(num_gpus=1) class worker(object):
It can only allow each worker to see 1 GPU, so is there any way that I can let each worker to see both 2 GPUs?
Also If I just set
@ray.remote(num_gpus=2), the program cannot launch in the setting of 2 workers, since the whole program request for 4 GPUs in total, which is not available on the current machine.