How to add readiness and liveness to the head and worker nodes of the ray serve cluster deployed by kuberay?
kuberay RayService
How to add readiness and liveness to the head and worker nodes of the ray serve cluster deployed by kuberay?
kuberay RayService
Hi, you can define the probes in template.spec.containers[0].readinessProbe
. template
is a PodTemplate, so you can configure it as a Pod. See here for more details.
Hi @Kai-Hsun_Chen,
Can you give a good sample for testing liveness/readiness for ray workers.
Given that they will be deploying multiple replica of application inside a worker node.
What is the best practice to define our liveliness or readiness probe with ray serve worker nodes