How can I validate requests in RayServe like its done in FastAPI with validation errors etc and return appropriate response code?
Can anyone please provide some thoughts on this. @Phillip?
1 Like
Hi @dashsatish, you can use Ray Serve together with FastAPI: https://medium.com/distributed-computing-with-ray/how-to-scale-up-your-fastapi-application-using-ray-serve-c9a7b69e786
Essentially, you use FastAPI as usual, and use Ray Serve’s ServeHandles to offload the computation.
1 Like
Hi @architkulkarni Thanks. All we are building is a very IO intensive micro-service. I think Raycore features would suffice while handling requests from uvicorn & fastapi