How to run a branch of Ray on GCP

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I have created my own branch in my ray fork and want to run some experiments on GCP as my local machine would need days to complete the trials. Now I am facing the difficulty of how to use my branch of Ray in the cloud when using the autoscaler?

On my local machine I would need to clone the Ray master and use the setup-dev.py to make the nightly build use the modified files of my branch. On GCP, however I would need to use my credentials to clone the whole ray fork and then also run the setup-dev.py to use my moifed files instead?

I gues there might be a workflow that is used by the Ray team internally on a regular basis. Would you share some infos of how to simplify running a branch in the cloud?

Cheers,
Simon

Using git clone and setup-dev.py in the autoscaling config’s setup commands is probably the best way to do it!

1 Like