How severe does this issue affect your experience of using Ray? High: It blocks me to complete my task. I’m just having a great time using Ray Train. It’s interface is so simple and yet very powerful! However, when I use Tensorflow Keras + Horovod for distributed multiworker training, my script…

Ray Train with Horovod does not use all GPUs on the node

Nitin_Pasumarthy June 8, 2022, 9:05pm 12

Got it. Not yet, @amogkam .

I’m working to overcome this limitation - Train with tune doesnt set the right logdir - #7 by matthewdeng which is a blocker for my work.

Topic		Replies	Views
GPU Scaling configuration for Tensorflow/Horovod/Pytorch Ray Tune	3	540	April 10, 2023
Ray multiprocessing together with distributed learning Ray Train	1	553	March 2, 2022
[RAY SGD] Train pytorch model on machine with 2 GPUs Ray Tune	2	427	February 19, 2021
How to launch multi-node job with Ray Train? Ray Train	9	2056	June 14, 2024
When to use multi gpus per worker for a training job	1	172	September 15, 2024