RLib on multiple GPUs with framework tf2

RLlib
1
  • Low: It annoys or frustrates me for a moment.

According to the algorithm documentation, algorithms like PPO, Impala etc should be able to run on multiple GPUs also when using Tensorflow.

However, when looking into AlgorithmConfig.framework it says that “tf_session_args – Configures TF for single-process operation by default.” I assume this needs to be changed to get Tensorflow to run on multiple GPUs?

If so what would that look like when running on say 2 GPUs on a single machine?

BR

Jorgen