Hi Rags and welcome to the Ray community! Can you try ray memory --stats-only to see how much memory your ops are using, if it’s 80%, consider adding more resources. Do any of your other logs show anything unusual?
Someone else was running into a similar issue here: Fetch for object reference timed out because no locations were found for the object - #3 by Buvaneash
There were also a few bug fixes for object store stuff that were shipped in the later 2.4X versions of Ray, so maybe you can also try upgrading your Ray version and seeing if that fixes any issues.