Why is GPU usage capped at 50% when training PPO?

Whenever I’m training a PPO, my CPU and GPU alternate. When the CPU workers are going through the environment, my CPU is at 100%. When the GPU is updating the parameters of the neural nets, it only reaches a maximum of 50%. Any ideas why and how to eke out extra performance from the GPU? It is currently the training speed bottleneck.