How severe does this issue affect your experience of using Ray?
- Medium: It contributes to significant difficulty to complete my task, but I can work around it.
I’m using the policy_server + policy_client to do some training on remote clients. My question is if there is any way for a client to know if a policy_server either: started, is in the process of, or completed an epoch?
The reason being, the training epoch takes ~25 seconds. During this time, the clients are stuck waiting for new actions and that gap time causes problems that I could handle more gracefully. (Currently I’m using times between received actions to scrap previous environments that may have completed in that ~25 seconds).
So if there is any way, please let me know - or the closest workaround, thanks!