Is Ray developed for doing shared memory computing or can I use it for distributed memory computing ? (there will be multiple nodes)
If you have any experience with MPI:
Can it be used as an alternative for Message Passing Interface (MPI)? If I develop my program with Ray, would its speed be significantly slower than an equivalent MPI program? Or will it be similar? Is Ray a suitable tool for high performance computing?