Job Submissions and job state notifications

Dashboard
1

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I understand we can periodically query the Job Submissions API, and HTTP poll for the job status. Are there any future plans to have these job states be piped to some kind of external pub-sub in real-time? For example, maybe I want to send these job state events into Google PubSub, so I can get the status on-the-fly for an individual job.

A side question that is a bit tangential (although somewhat related to this :slight_smile: ) is would there be any plans for HA with Job Submissions in Ray 2.0+?

2

cc: @aguo @architkulkarni

3

As far as I know we don’t have any plans for publishing the job status.

Regarding HA for job submission, could you share more about what that would look like? We have support for HA Services in Ray 2.0:

Would this support your use case?