How severe does this issue affect your experience of using Ray?
- High: It blocks me to complete my task.
I’m recording observations for future training, and they are currently recorded on the workers.
I would like to download all observations from all workers with one command, similar to how I can use ray rsync_down to copy checkpoints from the head node.
It seems that ray rsync_down only works with the head node. Maybe there is a parameter I could specify to get it to look on worker nodes as well?
I have 200+ worker node instances, so assembling files by hand would be a very lengthy process.