Latest Ray Serve topics

Topic	Replies	Views	Activity
Ray Serve Survey April 2023 Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023	1	425	April 12, 2023
About the Ray Serve category	0	776	November 17, 2020
Dynamic Deployment on Ray Serve	1	7	February 22, 2025
How to check the lengh of queue for each replica of deployment	7	780	February 19, 2025
Why are `ray_actor_options` and the `rayClusterConfig` configured separately?	3	37	February 14, 2025
_local_testing_mode in serve.run	3	32	February 12, 2025
Multiple Independent Models behind a single API endpoint?	3	44	January 30, 2025
Redeploy Ray Serve applications Daily on K8's	1	17	January 27, 2025
Ray Serve Latest version vLLM example requires code modification to work	3	122	January 23, 2025
Ray Serve - Client request Cancellation	0	44	January 2, 2025
Looking for a way to cancel ray serve task	4	688	December 23, 2024
Ray is creating hundreds of logs files under /tmp/ray/session_latest/logs/ causing disk space issue and I/O Spikes	7	811	December 17, 2024
Check failed: worker->GetAssignedJobId().IsNil()	1	25	December 11, 2024
Scaling Ray Serve efficiently	0	27	December 10, 2024
Dynamically serve new model via Ray Serve	0	25	December 7, 2024
Ray serve: no attribute 'add_done_callback'	6	866	November 27, 2024
Seldon Core VS Ray Serve	1	1854	January 24, 2023
Best Way to Pipeline Serve App	3	63	November 21, 2024
Gpu allocation for ray serve on multi gpu environment	5	126	November 18, 2024
Configuring Ray Serve Logging: JSON Formatting, Stream Handling, and CLI Output	1	33	November 6, 2024
How to post data to dynamic batch directly？	1	31	October 24, 2024
Rayserve fault tolerance	0	31	October 22, 2024
Ray serve blocking requests when serving an LLM	3	71	October 20, 2024
.remote() call occasionally hangs	3	146	October 7, 2024
vLLM Inferencing on multiGPU	7	488	September 24, 2024
Difference between the job of Serve Ingress and Proxy Actor?	2	36	September 24, 2024
How to deploy Serve http service to cluster?	2	26	September 17, 2024
Deployment has taken more than 30s to initialize. This may be caused by a slow __init__ or reconfigure method	2	171	September 16, 2024
I want to new different serve by different container，and i want to add them into a running ray cluster without kuberay ，them i can monitor them in the same dashboard	3	18	September 15, 2024
How to use "Run Multiple Applications in Different Containers" feature in kuberay?	3	209	September 15, 2024

Ray Serve Survey April 2023

Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023