Hello, it is possible to use Ray Serve with gRPC endpoint?

Hello, it is possible to use Ray Serve with gRPC endpoint?

2 Likes

@Oyin

Did you resolve this or did you find anything related to serving with gRPC endpoint.

@Oyin Hi we’ve created an RFC for gRPC in [Feature] RFC-Serve: Support gRPC · Issue #20854 · ray-project/ray · GitHub and open to community feedback with their examples, it will be great if you can comment there with your context so we can better gauge the demand for prioritization, thanks !