I’'m running a cluster on my laptop with ray start --head
and launching my program with
with ray.init(address='auto', ignore_reinit_error=True):
...
When object store is full, object spilling fails with
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/ray/session_2023-05-07_09-24-33_669967_36323/ray_spilled_objects/37539b8a4799451eb12c9c4e96bdcc16-multi-27'
An unexpected internal error occurred while the IO worker was spilling objects: [Errno 2] No such file or directory: '/tmp/ray/session_2023-05-07_09-24-33_669967_36323/ray_spilled_objects/37539b8a4799451eb12c9c4e96bdcc16-multi-27'
Is there any additional configuration I need to set? How do I make spilling work properly?