Does DDPPO example code uses GPU?

Ray Libraries (Data, Train, Tune, Serve) Ray Tune
1

I’m trying to use tuned-example DDPPO.

This configuration uses “num_gpus_per_worekr” = 1, so I think it would use gpu.
However, it doesn’t uses gpu when I check it with nvidia-smi.
Is there any way to make ddppo use the gpu?

My experiment setups are followings.

  • ubuntu 18.04,
  • python 3.7
  • ray 1.5.1
  • GPU: A100
2

It should. The whole point of DDPPO is to compute gradients on the worker nodes.
Can you file an issue against RLlib here?

with setup and steps to reproduce, etc. we will take a look.
thanks.