I would like to use the the following command
`ray up -vvv ray/python/ray/autoscaler/gcp/example-full.yaml`
from here to set up ray on GCP dataproc cluster.
When I run the command, the master node gets created, but it doesn’t get past
[1/7] Waiting for SSH to become available. When I inspect the ssh uptime command, I see two issues
For security reasons, my employer doesn’t want me to create VMs with public IP addresses.
To interact with an instance, I have to use IAP for TCP forwarding. For example, when I ssh into an instance, I have to use a command like
gcloud compute ssh dutch@instance-name --tunnel-through-iap
I don’t know of any standard ssh command that replicates this functionality.
I can install ray on dataproc using the manual setup, but are there any workarounds that would enable me to use the cluster launcher script?