Hey there michaelripa, welcome to the Ray community! I was able to find an example of a similar error on the forums here: Exception("Can't run an actor the server doesn't have a handle for")
While it’s not the same exact circumstance, can you let me know if this helps out at all? (There’s more discussion here Serve.shutdown() and how to reconnect to cluster - #4 by luisp)