Ray serve blocking=True does not work

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I’m trying to deploy my model on Ray. I’m following the below code to deploy my model –

from ray import serve

class MyClass:

app = MyClass.bind()

while True:

I think the while loop there is probably not the best way to block the program from exiting… is there a better way to keep ray serve running?

I’ve already tried serve.run(app,_blocking=True) but that does not seem to be working.

Can you please help me out?