Hi I am currently trying to explore the RayServe for inference use case. However when I tried to deploy the service on my local kubernetes cluster using kind the head pod flag as unhealthy and did not start the dashboard. The log I got is this
2025-09-04 00:28:42,864 INFO utils.py:303 -- Get all modules by type: DashboardHeadModule
2025-09-04 00:28:43,110 INFO utils.py:336 -- Available modules: [<class 'ray.dashboard.modules.usage_stats.usage_stats_head.UsageStatsHead'>]
2025-09-04 00:28:43,110 INFO head.py:234 -- DashboardHeadModules to load: None.
2025-09-04 00:28:43,110 INFO head.py:237 -- Loading DashboardHeadModule: <class 'ray.dashboard.modules.usage_stats.usage_stats_head.UsageStatsHead'>.
2025-09-04 00:28:43,110 INFO head.py:241 -- Loaded 1 dashboard head modules: [<ray.dashboard.modules.usage_stats.usage_stats_head.UsageStatsHead object at 0xffff83ba2ae0>].
2025-09-04 00:28:43,110 INFO utils.py:303 -- Get all modules by type: SubprocessModule
2025-09-04 00:28:43,111 INFO utils.py:336 -- Available modules: [<class 'ray.dashboard.modules.metrics.metrics_head.MetricsHead'>, <class 'ray.dashboard.modules.data.data_head.DataHead'>, <class 'ray.dashboard.modules.event.event_head.EventHead'>, <class 'ray.dashboard.modules.job.job_head.JobHead'>, <class 'ray.dashboard.modules.node.node_head.NodeHead'>, <class 'ray.dashboard.modules.reporter.reporter_head.ReportHead'>, <class 'ray.dashboard.modules.serve.serve_head.ServeHead'>, <class 'ray.dashboard.modules.state.state_head.StateHead'>, <class 'ray.dashboard.modules.train.train_head.TrainHead'>]
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.metrics.metrics_head.MetricsHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.data.data_head.DataHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.event.event_head.EventHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.job.job_head.JobHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.node.node_head.NodeHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.reporter.reporter_head.ReportHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.serve.serve_head.ServeHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.state.state_head.StateHead'>.
2025-09-04 00:28:43,111 INFO head.py:291 -- Loading SubprocessModule: <class 'ray.dashboard.modules.train.train_head.TrainHead'>.
2025-09-04 00:28:43,111 INFO head.py:295 -- Loaded 9 subprocess modules: [<ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff741db6b0>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff74d25ac0>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff8552b140>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff79f90a70>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff7e912900>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff74133e00>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff7dbeaed0>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff7dbe9e50>, <ray.dashboard.subprocesses.handle.SubprocessModuleHandle object at 0xffff7dbeb800>].
2025-09-04 00:28:45,055 ERROR dashboard.py:304 -- The dashboard on node rayservice-sample-x6hxc-head-tfvlq failed with the following error:
Traceback (most recent call last):
File "/home/ray/anaconda3/lib/python3.12/site-packages/ray/dashboard/subprocesses/handle.py", line 144, in wait_for_module_ready
self.parent_conn.recv()
File "/home/ray/anaconda3/lib/python3.12/multiprocessing/connection.py", line 250, in recv
buf = self._recv_bytes()
^^^^^^^^^^^^^^^^^^
File "/home/ray/anaconda3/lib/python3.12/multiprocessing/connection.py", line 430, in _recv_bytes
buf = self._recv(4)
^^^^^^^^^^^^^
File "/home/ray/anaconda3/lib/python3.12/multiprocessing/connection.py", line 399, in _recv
raise EOFError
EOFError
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/ray/anaconda3/lib/python3.12/site-packages/ray/dashboard/dashboard.py", line 293, in <module>
loop.run_until_complete(dashboard.run())
File "/home/ray/anaconda3/lib/python3.12/asyncio/base_events.py", line 691, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/home/ray/anaconda3/lib/python3.12/site-packages/ray/dashboard/dashboard.py", line 94, in run
await self.dashboard_head.run()
File "/home/ray/anaconda3/lib/python3.12/site-packages/ray/dashboard/head.py", line 404, in run
handle.wait_for_module_ready()
File "/home/ray/anaconda3/lib/python3.12/site-packages/ray/dashboard/subprocesses/handle.py", line 146, in wait_for_module_ready
raise RuntimeError(
RuntimeError: Module ReportHead failed to start. Received EOF from pipe.
Is there a way for me to debug this?
Image used: rayproject/ray:2.47.1-py31