I have Ray Serve on Kubernetes EKS on AWS.
The EKS Pod takes 5 min to be in running state but sometomes in Ray Dashboard , i see that it takes 10 min for it to be healthy.
Anyone knows why is that ?
This is my EKS pod health check when it becomes ready
"wget -T 2 -q -O- ``http://localhost:52365/api/local_raylet_healthz`` | grep success"