Syncing interval of policy?

RLlib
1

How severe does this issue affect your experience of using Ray?
Pretty Annoying

Hi! In rllib, especially SAC, what is the syncing interval? I. E. Time or steps to send copy of policy network to workers?
In the sync config document, it said 5 minutes. Is this the correct value?

If it is, i have 24 workers which will make the data very stale. Is this right also?

Or is it synced every iteration? So i don’t need to worry about the staleness of the data?

Thank you!

2

@iykim The SyncConfig has no relation to RLlib model syncing behavior. Instead, it’s referring to file syncing for artifacts that are saved in the trial local directory. You should not need to worry about this as an RLlib user.