[Core] Ray Multiprocessing Pool Progress Tracker

Hey @jgjoseph you should be able to do something simple like:

with open("progress.txt", "w") as f:
    for result in Pool.imap_unordered(func, inputs):
        print(result, file=f)

imap_unordered will return results in any order as they finish, so you can track progress this way.

1 Like