RLlib's PolicyServer and external simulator as client

Ah yes, sorry, I remember your use-case (no python on the client side :stuck_out_tongue_winking_eye:)
Hmm, wouldn’t say this is not normal for a model to take up a long time to do a computation. How many parameters does your model have? Also torch or tf?

1 Like