How to deploy Serve http service to cluster?

Ray Libraries (Data, Train, Tune, Serve) Ray Serve
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Hi,

I want to deploy a Serve http service (using FastAPI) to GCP. I can start the http service locally fine, and I can start the Ray cluster on GCP. I’m strugggling to find the documentation which describes the next step, which is to get my http service running on the remote cluster. Is there something you could point me to? Thanks,

dmj

2

See here

3

Thanks. This is just a proof-of-concept at the moment, so I was kind of hoping to avoid kubernetes for now. Is there a way to just do serve deploy myconfig.yaml to a remote cluster?