Real-time video processing and machine control

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I’d like to process real-time video for machine control. I have this loop:

while True:
  get frame from camera
  analyze
  send messages to other actors
  draw on frame
  store frame in global variable so it can be streamed over HTTP 
  respond to outside commands (e.g. start, stop)

How might you do this with Ray actors?

In Elixir, I might do my having the actor send itself a message after processing each frame plus an initial message in the actor initializer to kick things off.