Model loaded to GPU memory but GPU memory is not being utilized

@saeid93 Thank you for the configuration. What does ray status tell you, if you run it? Or do you run locally without a cluster?

And did you also include the GPU request into your tune resources as shown in @kai 's answer in another thread?