Hi all! I am trying to run PPO using a GPU for the trainer. My setup is the following: Ray v2.0.0 Tensorflow 2.4 Cuda 11.0 Tensorflow works fine with GPUs. However, when I run the PPO algorithm with “rllib train”, the GPUs are not detected and I get the following error: RuntimeError: GPUs wer…

Hi Fot, I have seen this error multiple times from running my own code. Do you have a script that you can post? Are you 100% sure that you use the same Cuda version when testing TF separately? What was the part that you removed that provokes the error?

Hi! I use the following configuration file: cartpole-appo: env: CartPole-v0 run: PPO stop: timesteps_total: 15000 config: # Works for both torch and tf. framework: tf train_batch_size: 750 num_envs_per_worker: 5 num_workers: 1 num_cpus_per_worker: 1 num_gpus: 1 num_gpus_per_worker: 1 …

The trainer has also a local worker, right? Maybe this worker is not able to see the GPUs, and causes this error? Also, a Ray actor can only see the GPUs, if the num_gpus is provided at its class declaration?

That might very well be. For one gpu you can use the following assignment from ray docs . You are requesting 2 GPUs with your config.

Hi! Yes, @Sertingolix you are right, I need only 1 GPU, and I request 2, thanks for pointing it out! I figured out there was an issue when the CUDA_VISIBLE_DEVICES was set for the tasks. The resources for the trainer are the following (requested 1 CPU and 1 GPU): {‘CPU_group_0’: [(0, 1.0)], ‘CPU…

@Fot , interesting catch. Yeah, the CUDA_VISIBLE_DEVICES=0,0 probably messes things up here. Glad you could fix your problem. “When I run this, 2 Ray actors are spawned, I believe the trainer and 1 Rollout worker?” Yes, this is correct. Also, the local worker (where training happens) will use the…

Hi @sven1977 @arturn I have the similar question, can you help me solve it ? [image] When I convert PPO to DDPPO in rllib for distributed training, it prompts: RuntimeError: No CUDA GPUs are available RLlib Thank you very much! It seems that these solutions you mentioned…

GPUs not detected

RLlib

zhangzhang February 21, 2023, 9:37am 8

Hi @sven1977 @arturn
I have the similar question, can you help me solve it ?

Topic		Replies	Views
Error when trying to use gpus during RL training RLlib	4	724	July 21, 2021
Questions about using GPU for the ray[rllib] RLlib	4	2403	August 4, 2023
GPU Detected but Not Utilized in Ray RLlib with PPO RLlib	1	806	June 15, 2024
Ray not finding available GPU on Windows RLlib	4	1107	September 6, 2021
PPO example cannot use GPU RLlib	4	579	August 7, 2021

GPUs not detected

Related topics