I’m currently relying on tune.Tuner to run my experiment on a machine that has 28 CPUs and 2 GPUs. Being that I’m not the only one who has access to this machine, I’d like to restrict my experiment to a single GPU. Despite specifying with_resources(Trainer, {"cpu": 1, "gpu": 1}) both GPUs are used.…

Hi @mtt , tune.with_resources sets the resources per trial, and since you have 5 trials with 2 GPUs, Tune will schedule 2 trials at a time, each taking one of the GPUs. You can specify fractional GPUs per trial, as well as limit concurrency so you never go above some GPU usage. For example, this wi…

How do I run my experiment on a single GPU?

Ray Libraries (Data, Train, Tune, Serve)

Xinchengzelin August 20, 2023, 12:53am 5

Thanks @matthewdeng, I create a new topic: How to use fraction GPU in `ray.tune.Tuner`?

Topic		Replies	Views
Training trials in parallel on multi-gpu machine Ray Tune	8	1608	August 23, 2021
Data Parallelism with Ray Tune Ray Libraries (Data, Train, Tune, Serve)	4	295	November 2, 2023
How to use fraction GPU in `ray.tune.Tuner`? Ray Train	6	1019	August 24, 2023
Allocating different GPUs to different instances of Ray(Tune) in python Ray Libraries (Data, Train, Tune, Serve)	5	468	August 9, 2023
Trials placed on the same GPU on a 2 GPU machine despite "num_gpus": 1 Ray Tune	4	784	April 13, 2021

How do I run my experiment on a single GPU?

Related topics