Looking for a way to cancel ray serve task

Ray Serve
1

I’ve deployed a prediction service using Ray serve. The predict service at times might take a while to finish. I want a way to cancel the ongoing prediction task. When I try to use ray.cancel using object ref it says Actor task cancellation is not supported.

2

Hi @plum9 , it does seem like this feature is not currently supported by Ray. If you like, you may file a feature request on the Ray Github by making a Github Issue and selecting “feature request” or “enhancement”.

3

Thanks, I’ve submitted a feature request.

4

This feature was released for Serve in Ray 2.8 (commit). Check out these docs to learn more.

5

is it possible for the client to cancel explicitly (and not with timeout)
using http api?
using grpc?