TPU with Ray Tune

Looking at both the tutorial on Pytorch official webpage and Ray official guidelines, it is not clear to me if it is possible to use TPU to perform hyperparameter search with Ray Tune. I am pretty new with this tool, and it appears that it offers full support only for CPU and GPU. In that case, I was wondering if moving all the TPU-related code inside the training loop/function (so, somehow constraining the execution on TPU) could be a feasible workaround. Any idea or suggestion regarding this? Thanks and sorry for the possibly naïve question.

2 Likes