How is GPU memory managed by Ray? Here is how I see the picture. An example:
import pandas import ray ray.init() df = pandas.DataFrame() o_ref = ray.put(df) @ray.remote(num_gpus=1) def foo(ref): # processing with ref foo.remote()
ray.put(df) is called, the data is put into plasma. When calling
foo the data is transferred to GPU memory to do some processing.
The question is: is the data left on GPU memory alive or cleaned up from there right away?
It would be great if there is some docs describing GPU memory management in Ray.
Thanks in advance!