Is it possible to know how many GPUs are available on the ray cluster on the driver side, prior to allocating work load?

ziwen_zhang October 20, 2021, 2:03am 1

I want to know how many GPUs are available on my ray cluster, so I can allocate jobs dynamically.

Topic		Replies	Views
Ray worker GPU count if GPU available Ray Core	2	846	August 1, 2022
How to specify GPU resources in terms of GPU RAM and not fraction of GPU Ray Core	3	537	November 26, 2021
Ray serve GPU allocation error, deployment consuming all 8 GPU even though setting num_gpus=4 Ray Serve	1	551	February 2, 2024
Ray cluster details doesn't show requested number of gpus Kubernetes	3	162	June 19, 2024
About using partial GPU Ray Core	1	376	December 4, 2020