I have Ray Serve running on EKS.
Now i use Karpeneter to creates / update nodes .
In my other apps we have PDB(Pod Disruption Budget) defined which when rotates nodes , it make minimum no of healthy replicas must exist.
How can i configure that ?
I have Ray Serve running on EKS.
Now i use Karpeneter to creates / update nodes .
In my other apps we have PDB(Pod Disruption Budget) defined which when rotates nodes , it make minimum no of healthy replicas must exist.
How can i configure that ?
Hi Mirage, welcome to the Ray community. You should still be able to configure a PDB for your nodes I think via your Kubernetes manifests. Are you seeing any issues trying to do so when you set up Ray on EKS? What problems are you running into?
This reading might be helpful too: ray/doc/source/cluster/kubernetes/user-guides/rayservice-no-ray-serve-replica.md at releases/2.47.1 · ray-project/ray · GitHub