I’m running hyperparameter with Ray Tune and I am using the Optuna search algorithm in combination with the ASHA scheduler.
My problem is that runs that reaches just after the grace period are stopped, even though there are no other runs. That did not happen with the first I ran a hyperparameter search. I suspect that it uses some metadata from previous searches? Is it possible to programmatically start hyperparameter fresh, that is always with a clean state?