Model composition with serve deployments, why?

Li_Bin · April 1, 2023, 1:07pm

since I can use ingress depoyment + plain tasks/actors, what is the advantage to use ingress deployment + nested depolyments ? Are there any cases where the later is the best choice?

Topic		Replies	Views
[Ray Serve] using GRPC and DAG to host multiple models(or actors) in the same deployment Ray Libraries (Data, Train, Tune, Serve)	3	327	February 2, 2023
Serve containerized model using Ray Serve? Ray Serve	0	282	July 12, 2023
Torch Ensemble serving Ray Serve	4	653	March 2, 2023
Splitting traffic to different deployments (A/B testing) Ray Serve	2	539	June 10, 2021
Ray and Microservices	1	524	March 10, 2023

Model composition with serve deployments, why?

Related Topics