Object Spilling


I keep getting messages of this kind,

/tmp/ray/session_2023-01-09_21-53-33_921408_1467486 is over 95% full, available space: 82558976; capacity: 46759010304. Object creation will fail if spilling is required

I am actually interested only in the high level table, is there a way to not store anything.

Hey @Gaddiel_Ouaknin,

Which high level table are you referring to?

Looks like the object store is full and Ray needs to spill to disk, but your disk is almost full. If Ray doesn’t spill to disk, I think your program would raise an out-of-memory error.

Relevant: Object Spilling — Ray 2.2.0