Latest Ray Serve topics

Topic	Replies	Views	Activity
Ray Serve Survey April 2023 Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023	1	424	April 12, 2023
About the Ray Serve category	0	776	November 17, 2020
Ray Serve - Client request Cancellation	0	18	January 2, 2025
Looking for a way to cancel ray serve task	4	678	December 23, 2024
Ray is creating hundreds of logs files under /tmp/ray/session_latest/logs/ causing disk space issue and I/O Spikes	7	760	December 17, 2024
Check failed: worker->GetAssignedJobId().IsNil()	1	21	December 11, 2024
Scaling Ray Serve efficiently	0	17	December 10, 2024
Dynamically serve new model via Ray Serve	0	13	December 7, 2024
Ray Serve Latest version vLLM example requires code modification to work	2	42	December 5, 2024
Ray serve: no attribute 'add_done_callback'	6	839	November 27, 2024
Seldon Core VS Ray Serve	1	1806	January 24, 2023
Best Way to Pipeline Serve App	3	51	November 21, 2024
Gpu allocation for ray serve on multi gpu environment	5	75	November 18, 2024
Configuring Ray Serve Logging: JSON Formatting, Stream Handling, and CLI Output	1	23	November 6, 2024
How to post data to dynamic batch directly？	1	26	October 24, 2024
Rayserve fault tolerance	0	28	October 22, 2024
Ray serve blocking requests when serving an LLM	3	50	October 20, 2024
.remote() call occasionally hangs	3	113	October 7, 2024
vLLM Inferencing on multiGPU	7	351	September 24, 2024
Difference between the job of Serve Ingress and Proxy Actor?	2	30	September 24, 2024
How to deploy Serve http service to cluster?	2	23	September 17, 2024
Deployment has taken more than 30s to initialize. This may be caused by a slow __init__ or reconfigure method	2	121	September 16, 2024
I want to new different serve by different container，and i want to add them into a running ray cluster without kuberay ，them i can monitor them in the same dashboard	3	14	September 15, 2024
How to use "Run Multiple Applications in Different Containers" feature in kuberay?	3	202	September 15, 2024
Serving triton models	2	121	September 13, 2024
Kuberay sample RayService not launching serve apps	11	578	September 10, 2024
Scaling up handeled requests when using the batching wrapper	2	29	September 6, 2024
Concurrency groups in Serve Deployments	1	19	September 5, 2024
Failed to get queue length from Replica	1	117	September 4, 2024
Understanding @serve.deployment	1	60	September 4, 2024

Ray Serve Survey April 2023

Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023