Odd behavior with Ray cluster setup with Docker

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I have been trying to use the Ray cluster yaml interface to spin up Ray clusters.

I’ve noticed that when the ray up command finishes, the workers just get started and are not connected to the head node. As a result if you immediately log on to the head node and start querying cluster_resources() you are not going to see the worker nodes. Is this expected behavior?

As a start, it would be great to let me know when the workers have finished setting up their setup commands.