Latest Ray Serve topics

Topic	Replies	Views	Activity
Ray Serve Survey April 2023 Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023	1	252	April 12, 2023
About the Ray Serve category	0	624	November 17, 2020
[Low] How to increase the number of workers for a controller or proxy service?	2	24	December 5, 2023
[High] Why doesn't parallelism work with data preprocessing?	10	126	December 2, 2023
Ray Serving multiple Diffusers models leads to OOM	4	41	November 30, 2023
Help designing fire and forget server for large batch inference	7	85	November 30, 2023
Autoscaling RayServe Pods in k8s keeps terminating and restarting pods	4	234	November 20, 2023
No request can complete until all requests are ready	14	148	November 14, 2023
Making model accesible across the nodes on Ray Serve - how	3	109	November 10, 2023
Define Custom Logger in Ray server application with multiple apps	3	103	November 9, 2023
Serve run cli to remote	1	103	November 9, 2023
[Low] Logging system messages and custom messages to the console	2	309	November 9, 2023
Background process with callback	1	60	November 8, 2023
How to redeploy ray-serve app	5	102	November 7, 2023
How to check the lengh of queue for each replica of deployment	6	116	October 30, 2023
Can Ray Serve handle https? [2023]	8	169	October 27, 2023
Ray Serve is executing the requests sequentially instead parallel even after configuring auto-scale	11	138	October 20, 2023
How to ensure ray serve using max replicas possible	3	108	October 19, 2023
Ray Serve get Header / Dynamic Batching with FastAPI	2	170	October 16, 2023
Limit the number of application that Ray launch to fit memory aviable	3	104	October 14, 2023
Ray.get delayed return results from deployment	9	249	October 13, 2023
Ray is creating hundreds of logs files under /tmp/ray/session_latest/logs/ causing disk space issue and I/O Spikes	1	125	October 13, 2023
Ray Serve Head fault tolerance	3	118	October 13, 2023
Best Practices for expanding FastAPI app	1	196	October 13, 2023
How to "bucket" batch requests on Serve?	1	107	October 13, 2023
How to return a gRPC status code?	1	146	October 13, 2023
Docker / Apps instantly shutdown after done creating replica	1	130	October 13, 2023
[Serve] Set placement group for deployment actors?	3	130	September 28, 2023
The example of ray serve deploying a service using serve deploy does not work	0	123	September 6, 2023
[Serve] Is it possible to serve a model without running a cluster	1	151	September 5, 2023

Ray Serve Survey April 2023

Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023