Hello,
I am running SAC combined with APEX in my real robotics environment (for asynchronous purposes). I have assumed that action should be executed once every 50 ms (a 20Hz control loop). However, when I profiled the execution I noticed that the overall inference time of the single step is 140 ms. The execution time on the robot side is approximately 30 ms, model inference time is 5-10ms. So my question is, what’s give such overhead in rllib?
Greg.