Ray serve blocking=True does not work

Ray Libraries (Data, Train, Tune, Serve) Ray Serve
1

How severe does this issue affect your experience of using Ray?

  • Medium: It contributes to significant difficulty to complete my task, but I can work around it.

I’m trying to deploy my model on Ray. I’m following the below code to deploy my model –

from ray import serve

@serve.deployment(num_replicas=2)
class MyClass:
      pass

app = MyClass.bind()
serve.run(app)

while True:
     time.sleep(2000)

I think the while loop there is probably not the best way to block the program from exiting… is there a better way to keep ray serve running?

I’ve already tried serve.run(app,_blocking=True) but that does not seem to be working.

Can you please help me out?