Hello @architkulkarni!
Thanks for your response! I will be watching the issue #26527.
Well, I decided to check the other Serve API functions. For instance, if I just call serve.list_deployments()
, then a local cluster is also created and I got the error “There is no instance running on this Ray cluster. Please call serve.start(detached=True) to start one.”
So I would like to suggest something else: Serve API functions should never create clusters. They could connect to an existing cluster. A remote cluster if RAY_ADDRESS is set. A local cluster otherwise.
Once again, thanks!!
And congratulations for the great project!