Allow overwriting trial dir instead of creating a new one

Ray Libraries (Data, Train, Tune, Serve) Ray Tune
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

As of Ray 2.2.0, when starting a trial w/ same logdir, Ray tune will automatically create a new dir w/ an added suffix. Yet there are use cases where I wanna just overwrite the existing one.

is there a way to achieve that?

2

Hi @Zhang_David, could you elaborate some more on your use case?

Would specifying the trial_dirname_creator in TuneConfig satisfy this requirement?

3

Apology for the late reply.

The use case would be failure and re-run. I understand that you could do Tuner.restore to ckpt and warm-start an entire experiment, but is that the only way recommended here?

Yes - I’m using trial_dirname_creator already to custom format the dir/file structure

4

Can you share a simple repro of the behavior you’re seeing?