Submitting jobs programatically

Ray Clusters
1

Hello, I was wondering how people are submitting jobs programatically.

Scenario:

  • Ray Cluster running on GKE
  • Web app / api running somewhere else

I want to be able to trigger jobs runs from my web app / api.
My jobs are relatively static (meaning the python code is the same, but the command line args / env vars vary), so ideally I am looking for something like LaunchJob('template-name', env={...}, args={...}).

I know that there’s the Ray CLI and Ray Client, but I did not see how one would properly authenticate with the remote cluster – ideally, one should be able to generate API key for the cluster and use those with the client.

2

@palmik One way is to configure TLS with cluster.

And as you point out, there are various ways to submit Ray jobs to the cluster.