Serve.shutdown() and how to reconnect to cluster

Hello @architkulkarni!

Thanks for your response! I will be watching the issue #26527.

Well, I decided to check the other Serve API functions. For instance, if I just call serve.list_deployments(), then a local cluster is also created and I got the error “There is no instance running on this Ray cluster. Please call serve.start(detached=True) to start one.

So I would like to suggest something else: Serve API functions should never create clusters. They could connect to an existing cluster. A remote cluster if RAY_ADDRESS is set. A local cluster otherwise.

Once again, thanks!!
And congratulations for the great project!