Passing information to ray script from job and back

Ray Clusters
1
  • Low: It annoys or frustrates me for a moment.

I want to try and use ray jobs
However the submitter of the job will need to pass to ray script a proto message and get back a proto message.
Is there a way to pass a binary object between the job and the script
If not binary object than json object perhaps

If the answer is no, how is one job supposed to be different from the other. What is the correct way of passing the information?

I am looking at short jobs (time perspective). Between 50ms to couple of seconds. So the data passing method should be light in resource requirements.

2

Currently there is no way to do that. You can use a cloud storage as a workaround: the ray script downloads the proto message from s3 and uploads the result proto message to s3.