I am currently trying to start a few actors that, inside their init functions, create torch models for inference. When I import this class from another file and run the code, I get an error from cloudpickle, "Cannot pickle “InterceptedNumpy” object " file a.py import ray import transformers impor…

I have a suspicion it is related to the implicit capture @sangcho describes here but I am not certain. [image] Best solution to have multiprocess working in actor? Ray Core Ray’s multi processing lib should be the drop-in replacement of mp library, but it doesn’t support …

I am not sure. After some fiddling, I removed the @ray.remote decorator and instead called the class_ = ray.remote(Class_) , then intantiated with: class_actor = class_.remote(*args) and this worked properly. I believe this moves away from the recommended way to define an actor. After some deb…

BTW, ray.remote is functionally the same as @ray.remote – I would say that there’s no recommendation between the two. In fact, fwiw I only use ray.remote(Class) and never the decorator :slight_smile:

Hi @rliaw , Thanks for your comment. I do like using the ray.remote(Class) as I can dynamically control options (a really nice feature) etc., which I only discovered because of this issue. That being said, something seems off about the registration of the imported class wrapped with @ray.remote, not…

I think this could be a pickle issue. I am not an pickle expert, but the biggest difference is where ray.remote is called (for @ray.remote, it is called in a file, and for others, it is called in your driver script). Is it working if you change your code in this way? @ray.remote class ModelPredicto…

I am going to give this a try. I have done something of the kind before. I will check and see if this solves that problem.

Error when Pickling Actor from an imported file

Ray Core

mannyv July 24, 2021, 12:19am 2

I have a suspicion it is related to the implicit capture @sangcho describes here but I am not certain.

Topic		Replies	Views
Best solution to have multiprocess working in actor? Ray Core	17	3435	May 20, 2021
Ray.cloudpickle error while pickling ray.dataset Ray Core	11	1784	January 13, 2023
RuntimeError: The actor with name TrainTrainable failed to import on the worker Ray Core	4	1511	November 15, 2022
Using ray's python code execution problem Ray Core	15	1185	January 10, 2023
How to configure a Ray cluster to have actor/task source code and avoid pickling overhead? Ray Core	4	588	February 24, 2023

Error when Pickling Actor from an imported file

Related topics