Getting data from remote node C++ API

Ray Core
1

How severe does this issue affect your experience of using Ray?

  • High: It blocks me to complete my task.

Hi all, I’m working on a cluster with two nodes (A & B).
The disk on node A contains a file that I wish to access from node B.
It’s not feasible (as far as I know) to use ray::Put/ray::Get since I can’t use ray object reference from node B.

Is there a way to transfer my file from node A to node B using the C++ API?

2

Through Ray, you can either:

  1. Load the file into object store memory then return it by ObjectRef.
  2. Manually copy the file to node A using a Ray task and something like rsync.