So I really enjoy the simple Ray FastAPI deployment, however I am unable to add websockets to my app. Is this a missing feature or am I simply doing something wrong?
Thanks for the question! Currently (2021/10) Serve doesn’t support websockets in FastAPI integration. You are not doing anything wrong. Can you explain a bit about the use case? Are you using websockets to stream predictions?
Hi Simon, thank you for your reply.
The use case is a machine learning application presenting results (opencv images) in a videostream. The video is currently streaming over ZeroMQ. However I was thinking I could reduce one dependency if I could stream over websocket.