[Tune + RLlib] Distributed hpo experiments choosing where the experiment mains are

Ray Tune
1

Is there a way to assign where the experiment mains will be scheduled for experiments in tune?

Can we use a resources flag? If I am using RLlib is there a way to hook to this that I want the Trainers on certain machines?

The reason I am asking is that only a few of my machines have access to some network directories so It is just easier if those are my roots and I use those directories for local_dir.

2

Oh yeah, you could probably specify a custom resource for the resources flag.

You’d also need to start a custom resource on the Ray workers for those machines (ray start --resources...)