I am currently running into some OOM issues on my GPU. I later found out that this bug boils down to
max_calls parameter for my actor.
I wonder what is the default value of
max_calls if no parameters are specified. By this I mean, say
@ray.remote def some_fn(): ...
In the official doc
ray==2.5.0, it says, by default,
num_gpus will be set to 0. And I also notice that
max_calls will be default to 1 to prevent GPU memory leakage only if
num_gpus>0. Can I interpret this as if no parameters are specified in
max_calls will be configured as infinite, which is default if only num_cpus are positive.
Another related question is, in doc of
.options() method, it says overriding
max_calls is not allowed. I wonder can we set
.options() for the case I just mentioned. And what is the rationale behind this design: does not support overwriting
Thanks in advance