I am using a DGX station with 4 GPUs (0-3) to tune a model. When I run tune, it picks all 4 GPUs and keeps them busy until the experiments are done. Is there a way for me to restrict it to GPUs 1-3? I would like to be able to keep GPU 0 to run the displays and other work.
You can do CUDA_VISIBLE_DEVICES=1,2,3 before running your Tune script, which will hide GPU 0 from Ray.
1 Like