Latest Ray Serve topics

Topic	Replies	Views	Activity
Ray Serve Survey April 2023 Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023	1	424	April 12, 2023
About the Ray Serve category	0	776	November 17, 2020
Using 0.0.0.0 is inaccessible on same subnet	0	1	November 22, 2024
Best Way to Pipeline Serve App	3	31	November 21, 2024
Ray serve: no attribute 'add_done_callback'	4	807	November 18, 2024
Gpu allocation for ray serve on multi gpu environment	5	37	November 18, 2024
Configuring Ray Serve Logging: JSON Formatting, Stream Handling, and CLI Output	1	11	November 6, 2024
How to post data to dynamic batch directly？	1	13	October 24, 2024
Rayserve fault tolerance	0	20	October 22, 2024
Ray serve blocking requests when serving an LLM	3	23	October 20, 2024
.remote() call occasionally hangs	3	76	October 7, 2024
vLLM Inferencing on multiGPU	7	181	September 24, 2024
Difference between the job of Serve Ingress and Proxy Actor?	2	23	September 24, 2024
How to deploy Serve http service to cluster?	2	20	September 17, 2024
Deployment has taken more than 30s to initialize. This may be caused by a slow __init__ or reconfigure method	2	68	September 16, 2024
I want to new different serve by different container，and i want to add them into a running ray cluster without kuberay ，them i can monitor them in the same dashboard	3	10	September 15, 2024
How to use "Run Multiple Applications in Different Containers" feature in kuberay?	3	199	September 15, 2024
Serving triton models	2	76	September 13, 2024
Kuberay sample RayService not launching serve apps	11	497	September 10, 2024
Scaling up handeled requests when using the batching wrapper	2	26	September 6, 2024
Concurrency groups in Serve Deployments	1	18	September 5, 2024
Failed to get queue length from Replica	1	75	September 4, 2024
Understanding @serve.deployment	1	30	September 4, 2024
Can Ray Serve handle https? [2023]	9	479	September 4, 2024
Issues with uniform/loguniform and batch_size after adjustments	0	24	August 30, 2024
gRPC service doesn't work for nested directory structures?	1	12	August 27, 2024
Sharing state between different replicas of a Ray Serve application	2	40	August 26, 2024
Failed to register worker to Raylet	1	115	August 14, 2024
[Serve] Is it possible to serve a model without running a cluster	2	331	August 14, 2024
Calling serve._run hangs	2	22	August 13, 2024

Ray Serve Survey April 2023

Hi folks, we’re collecting feedback on Ray Serve, and we’d love to hear your thoughts! Please fill out this 3-5 minute survey on your experience with Ray Serve. Survey: tinyurl.com/serve-survey-april2023