I’ve deployed a prediction service using Ray serve. The predict service at times might take a while to finish. I want a way to cancel the ongoing prediction task. When I try to use ray.cancel using object ref it says Actor task cancellation is not supported.
Hi @plum9 , it does seem like this feature is not currently supported by Ray. If you like, you may file a feature request on the Ray Github by making a Github Issue and selecting “feature request” or “enhancement”.
Thanks, I’ve submitted a feature request.
This feature was released for Serve in Ray 2.8 (commit). Check out these docs to learn more.
2 Likes