Dynamically scaling

The docs mention that update_backend_config is deprecated ray.serve.api — Ray v2.0.0.dev0

How can we dynamically scale things like num_replicas going forward?

My use case is that nodes and join and leave at any time.

Hi @raywala sorry for the late reply here. You can update the number of replicas by redeploying a deployment. Either run the same file with the number of replicas changed or you can do it dynamically like this:

my_deployment = serve.get_deployment("name")
my_deployment.options(num_replicas=100).deploy()