eg4l
June 18, 2021, 5:55am
1
Pardon my lack of knowlegde.
If I understand correctly when using Cluster Launcher I have and option to set file_mounts and it syncs files to all nodes and then I can use ‘ray rsync-down’ to download files from Cluster head.
How could I do those things while the using Cluster Operator instead of Cluster Launcher?
Dmitri
June 22, 2021, 5:48pm
2
This is a great question - syncing files up can be handled using the “working_dir” setting of Runtime environments.
Syncing files up can be handled using the working_dir setting of runtime environments:
https://docs.ray.io/en/master/advanced.html#runtime-environments-experimental
I don’t think we currently have a built-in answer for syncing files down.
I’ve opened a feature request:
opened 05:47PM - 22 Jun 21 UTC
enhancement
### Describe your feature request
The deprecated K8s cluster launcher support… ed syncing files from cluster to laptop, but the operator does not.
We may want a Ray-internal system for syncing files/directories down and between nodes.
For feature requests or questions, post on our Discussion page instead: https://discuss.ray.io/
Dmitri
June 22, 2021, 11:45pm
3
Come to think of it, kubectl cp
is an option here.
eg4l
June 29, 2021, 3:40pm
4
Sorry for my slow reply. Your answear helped me very much and I really do appreciate your help.
1 Like