How can I do load balancing in cluster?

Ray Clusters
1
  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I am launching cluster using cluster.yaml file in ray. I have three worker nodes. I want to do load balancing between this three worker nodes. For single job, pipeline has multiple actors.

Can someone please help me?

1 Like
2

If this is related to: How to assign different custom resources for each worker nodes? - #2 by ckw017

Then that should be able to work for your usecase. Note that you might want to increase the custom resources amount higher if you want to be able to schedule multiple tasks on each node (or alternatively use fractional resource amounts)

3

Yes, it is related to mention one.

Here, from this question, I would like to know the other strategies which I can implement for load balancing.