Add breakpoint to Ray Serve deployment

Monitoring & Debugging
1

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

Hi all, I first set a local Ray Cluster with ray start --head --ray-debugger-external, then I use the following code snippet for a Ray Serve Deployment.

app = FastAPI()
ray.init(address="auto", namespace="serve")
serve.start(detached=True)

@serve.deployment(route_prefix="/api1", num_replicas=1)
@serve.ingress(app)
class FastAPIWrapper1:
    @app.get("/")
    async def method(self):
        a = 7
        breakpoint()
        return "Hello 1!"

FastAPIWrapper1.deploy()

After sending a request to the endpoint, I could see this info in Ray Dashboard: RemotePdb session open at 127.0.0.1:65139, use 'ray debug' to connect.... But I could not see any breakpoint index after inputting ray debug in terminal, how should I solve this issue?

Thanks in advance.

2

Which Ray version are you using? Is it happening in ray 2.0? @Rui
cc: @sangcho

3

Hmm I think I can reproduce the issue. Do you mind creating an issue? Maybe a bug from the ray debugger