Serve host on VM - needs restart to work

Ray Libraries (Data, Train, Tune, Serve) Ray Serve
1

How severe does this issue affect your experience of using Ray?

  • Low: It annoys or frustrates me for a moment.

I am using cloud VM to work on and I am following the process to write ray serve app with fastapi.
First starting local ray cluster within my environment with:

ray start --head --dashboard-host 0.0.0.0

then starting ray serve:

serve start --http-host 0.0.0.0
serve run --reload serve:app

Then I can access the endpoint of the VM, I have lets say “/test”, without issues. But then after I for example change code or break something in the app and then again start it with:

serve run --reload serve:app

The requests get ignored as if I did not set host to 0.0.0.0. Then IF I shutdown serve and start it again with

serve start --http-host 0.0.0.0
serve run --reload serve:app

I can send requests again no problem.

edit:

serve run --host 0.0.0.0 --reload serve:app

works without issues but shows deprecation warning
ray version=2.9.2