Splitting Traffic Between Backends

In the old Ray documentation Advanced Topics, Configurations, & FAQ β€” Ray v1.0.0 this topic was covered quite well, but in a new documentation this topic disappeared. Did you deprecate this functionality?

Hi @blublinsky thank you for your question! We are in the process of deprecating current splitting traffic support because we found that it’s rarely used and typically people just want one deployment with rolling upgrade capability.

With the said, we are still going to support that capability with more fine grained rolling upgrade options, and a customizable pipeline concept that can be used to implement traffic splitting.

The pipeline concept RFC is available at [Public] [Serve] Pipeline Proposal Draft - Google Docs and I would encourage you to check back in 1 month to see our experimental release!

1 Like

Can you share an example of how same functionality can be achieved in newer ray versions?