Doc says Tune Trial Schedulers can modify hyperparamters - but how to do it?

Ray Tune
1

In the documentation it is written:

Trial Schedulers can … alter hyperparameters of a running trial.

However it seems there is no scheduler class listed that does that. Am I missing something, do I understand something wrong?

For example if I want to use a scheduler to change, e.g. the batch size, could TrialSchedulers do that and how?

2

To my understanding, this comment relates to the PBT scheduler. I am rather using ASHA, so I cannot judge on it. But toy model example will show :slight_smile:

2 Likes
3

Thank you this might be helpful. I expected something a bit different, i.e. a real mid-flight adjustment of a running trial without save & restore.

Currently I have an Algorithm callback that allows me to update the config and all EnvRunners mid-training and thought maybe there is an already built-in callback way that allows this via schedulers.

I’ll dig into PTB and see how it fits my purpose. :heart: