FastAPI and Websockets

So I really enjoy the simple Ray FastAPI deployment, however I am unable to add websockets to my app. Is this a missing feature or am I simply doing something wrong?

1 Like

Thanks for the question! Currently (2021/10) Serve doesn’t support websockets in FastAPI integration. You are not doing anything wrong. Can you explain a bit about the use case? Are you using websockets to stream predictions?

Hi Simon, thank you for your reply.

The use case is a machine learning application presenting results (opencv images) in a videostream. The video is currently streaming over ZeroMQ. However I was thinking I could reduce one dependency if I could stream over websocket.