# Ray.tune with Pytorch DDP

**URL:** <https://discuss.ray.io/t/ray-tune-with-pytorch-ddp/8408>\
**Category:** Ray Tune\
**Created:** [November 23, 2022, 2:24am UTC](https://discuss.ray.io/t/ray-tune-with-pytorch-ddp/8408 "2022-11-23T02:24:05Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Xinchengzelin](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/xinchengzelin/32/3352_2.png) [@Xinchengzelin](https://discuss.ray.io/u/Xinchengzelin)\
**Post date:** [November 23, 2022, 2:24am UTC](https://discuss.ray.io/t/ray-tune-with-pytorch-ddp/8408/1 "2022-11-23T02:24:05Z")

</div>

**How severe does this issue affect your experience of using Ray?**

- None: Just asking a question out of curiosity
- Low: It annoys or frustrates me for a moment.
- Medium: It contributes to significant difficulty to complete my task, but I can work around it.
- High: It blocks me to complete my task.

[As the tutorial here](https://docs.ray.io/en/latest/tune/tutorials/tune-resources.html#how-to-run-distributed-training-with-tune), If I use Pytorch DDP for training, I must change to use `ray.train` to use `ray.tune`?

I asked this question because I want to use wonderful `ray.tune`, however, I couldn’t use `ray.train`, because I haven’t found the solution for `torch.util.data.Dataset`, as descirbed [here](https://discuss.ray.io/t/how-to-convert-pytorch-torch-utils-data-dataset-to-ray-data-dataset/8025/13)

---

<div class="post-metadata">

**Author:** ![Xinchengzelin](https://sea2.discourse-cdn.com/flex020/user_avatar/discuss.ray.io/xinchengzelin/32/3352_2.png) [@Xinchengzelin](https://discuss.ray.io/u/Xinchengzelin)\
**Post date:** [November 23, 2022, 7:06am UTC](https://discuss.ray.io/t/ray-tune-with-pytorch-ddp/8408/2 "2022-11-23T07:06:38Z")

</div>

`ray.train` is not necessary for `ray.tune` with Pytorch DDP, and I find the solution [here](https://github.com/ray-project/ray/issues/7215)