Ray.tune with Pytorch DDP

How severe does this issue affect your experience of using Ray?

  • None: Just asking a question out of curiosity
  • Low: It annoys or frustrates me for a moment.
  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.
  • High: It blocks me to complete my task.

As the tutorial here, If I use Pytorch DDP for training, I must change to use ray.train to use ray.tune?

I asked this question because I want to use wonderful ray.tune, however, I couldn’t use ray.train, because I haven’t found the solution for torch.util.data.Dataset, as descirbed here

ray.train is not necessary for ray.tune with Pytorch DDP, and I find the solution here