Analyse Ray Tune Results similar to Optuna Dashboard

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

For Optuna GitHub - optuna/optuna-dashboard: Real-time Web Dashboard for Optuna. provides a nice way to visualize all hyperparameters and their effect on training. After a first iteration, one can reduce the search space and/or even remove complete options from the considered hyperparameters.
Obviously, this data can also be coaxed from a tune analysis object and its provided data frame, but that takes quite some effort to produce all these graphs. How do you analyze your tune results?
Another way I could imagine would be to expose the storage option from the Optuna study used by ray such that the standard optuna dashboard can be used.

3 Likes